Commit graph

18 commits

Author SHA1 Message Date
Gabriel Augendre 2be058d486 Update fields and index 2018-11-23 12:18:33 +01:00
Gabriel Augendre 6f6b4ed34b Update index to use 2018-11-23 11:23:40 +01:00
Gabriel Augendre ff72252625 Fix ID 2018-11-23 10:52:43 +01:00
Gabriel Augendre 797dd0eeaf Use a start url 2018-11-20 14:48:22 +01:00
Gabriel Augendre 27d49980ed Add start script 2018-11-20 14:32:20 +01:00
Gabriel Augendre 9958d50aa9 Remove some fields from config as we don't use them anymore + add genre field 2018-11-20 14:31:38 +01:00
Gabriel Augendre 27214bb1e0 Add genre and start from Youtube home page 2018-11-20 11:45:41 +01:00
Gabriel Augendre f00529bb58 Add more logging 2018-11-20 10:29:28 +01:00
Gabriel Augendre e8eb418e0b Extract parallelism and max depth to config 2018-11-20 10:21:24 +01:00
Gabriel Augendre 0ea086dc43 Limit parallelism 2018-11-20 09:35:31 +01:00
Gabriel Augendre 287424055e Use right fields for elastic 2018-11-20 08:50:34 +01:00
Gabriel Augendre 37e37260f2 Use custom index name in elastic 2018-11-19 18:28:49 +01:00
Gabriel Augendre f76e8bbf42 Use an event ID 2018-11-19 18:21:56 +01:00
Gabriel Augendre 03138d3809 Add update instructions in readme 2018-11-18 19:02:51 +01:00
Gabriel Augendre 007dbdd3a9 Stop the beat when no more videos to fetch 2018-11-18 18:46:54 +01:00
Gabriel Augendre d0ded4fd02 Add code and dependencies 2018-11-18 15:32:28 +01:00
Gabriel Augendre 5708f479a2 Add start url field 2018-11-18 11:23:00 +01:00
Gabriel Augendre 38fd446535 Add generated youtubebeat files 2018-11-18 11:08:38 +01:00