You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Gabriel Augendre f87c43dca5 Update 'README.md' 1 year ago
_meta Update fields and index 4 years ago
beater Fix ID 4 years ago
cmd Add generated youtubebeat files 4 years ago
config Use a start url 4 years ago
data Add code and dependencies 4 years ago
docs Update fields and index 4 years ago
include Update fields and index 4 years ago
logs Add code and dependencies 4 years ago
tests/system Add generated youtubebeat files 4 years ago
vendor Add code and dependencies 4 years ago
.editorconfig Add generated youtubebeat files 4 years ago
.gitignore Add generated youtubebeat files 4 years ago
.travis.yml Add generated youtubebeat files 4 years ago
CONTRIBUTING.md Add generated youtubebeat files 4 years ago
LICENSE Update 'LICENSE' 1 year ago
LICENSE.txt Add generated youtubebeat files 4 years ago
Makefile Add generated youtubebeat files 4 years ago
NOTICE.txt Add generated youtubebeat files 4 years ago
README.md Update 'README.md' 1 year ago
fields.yml Update fields and index 4 years ago
magefile.go Add generated youtubebeat files 4 years ago
main.go Add generated youtubebeat files 4 years ago
main_test.go Add generated youtubebeat files 4 years ago
make.bat Add generated youtubebeat files 4 years ago
monitoring.sh Add start script 4 years ago
youtubebeat.reference.yml Update fields and index 4 years ago
youtubebeat.yml Update fields and index 4 years ago

README.md

Youtubebeat

Welcome to Youtubebeat.

Ensure that this folder is at the following location: ${GOPATH}/src/github.com/Crocmagnon/youtubebeat

Getting Started with Youtubebeat

Requirements

Init Project

To get running with Youtubebeat and also install the dependencies, run the following command:

make setup

It will create a clean git history for each major step. Note that you can always rewrite the history if you wish before pushing your changes.

To push Youtubebeat in the git repository, run the following commands:

git remote set-url origin https://github.com/Crocmagnon/youtubebeat
git push origin master

For further development, check out the beat developer guide.

Build

To build the binary for Youtubebeat run the command below. This will generate a binary in the same directory with the name youtubebeat.

make

Run

To run Youtubebeat with debugging output enabled, run:

./youtubebeat -c youtubebeat.yml -e -d "*"

Test

To test Youtubebeat, run the following command:

make testsuite

alternatively:

make unit-tests
make system-tests
make integration-tests
make coverage-report

The test coverage is reported in the folder ./build/coverage/

Update

Each beat has a template for the mapping in elasticsearch and a documentation for the fields which is automatically generated based on fields.yml by running the following command.

make update

Cleanup

To clean Youtubebeat source code, run the following commands:

make fmt
make simplify

To clean up the build directory and generated artifacts, run:

make clean

Clone

To clone Youtubebeat from the git repository, run the following commands:

mkdir -p ${GOPATH}/src/github.com/Crocmagnon/youtubebeat
git clone https://github.com/Crocmagnon/youtubebeat ${GOPATH}/src/github.com/Crocmagnon/youtubebeat

For further development, check out the beat developer guide.

Packaging

The beat frameworks provides tools to crosscompile and package your beat for different platforms. This requires docker and vendoring as described above. To build packages of your beat, run the following command:

make release

This will fetch and create all images required for the build process. The whole process to finish can take several minutes.

Deploy

env PLATFORMS='linux' make release; and scp build/distributions/youtubebeat-6.5.0-linux-x86.tar.gz REMOTE_SERVER:/tmp/ELK; and ssh REMOTE_SERVER "cd /tmp/ELK; rm -rf youtubebeat-6.5.0-linux-x86; tar xvf youtubebeat-6.5.0-linux-x86.tar.gz"

Reuse

If you do reuse my work, please consider linking back to this repository 🙂