No description
Find a file
2022-01-02 19:29:50 +01:00
_meta Update fields and index 2018-11-23 12:18:33 +01:00
beater Fix ID 2018-11-23 10:52:43 +01:00
cmd Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
config Use a start url 2018-11-20 14:48:22 +01:00
data Add code and dependencies 2018-11-18 15:32:28 +01:00
docs Update fields and index 2018-11-23 12:18:33 +01:00
include Update fields and index 2018-11-23 12:18:33 +01:00
logs Add code and dependencies 2018-11-18 15:32:28 +01:00
tests/system Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
vendor Add code and dependencies 2018-11-18 15:32:28 +01:00
.editorconfig Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
.gitignore Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
.travis.yml Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
CONTRIBUTING.md Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
fields.yml Update fields and index 2018-11-23 12:18:33 +01:00
LICENSE Update 'LICENSE' 2022-01-01 22:28:00 +01:00
LICENSE.txt Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
magefile.go Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
main.go Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
main_test.go Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
make.bat Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
Makefile Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
monitoring.sh Add start script 2018-11-20 14:32:20 +01:00
NOTICE.txt Add generated youtubebeat files 2018-11-18 11:08:38 +01:00
README.md Update 'README.md' 2022-01-02 19:29:50 +01:00
youtubebeat.reference.yml Update fields and index 2018-11-23 12:18:33 +01:00
youtubebeat.yml Update fields and index 2018-11-23 12:18:33 +01:00

Youtubebeat

Welcome to Youtubebeat.

Ensure that this folder is at the following location: ${GOPATH}/src/github.com/Crocmagnon/youtubebeat

Getting Started with Youtubebeat

Requirements

Init Project

To get running with Youtubebeat and also install the dependencies, run the following command:

make setup

It will create a clean git history for each major step. Note that you can always rewrite the history if you wish before pushing your changes.

To push Youtubebeat in the git repository, run the following commands:

git remote set-url origin https://github.com/Crocmagnon/youtubebeat
git push origin master

For further development, check out the beat developer guide.

Build

To build the binary for Youtubebeat run the command below. This will generate a binary in the same directory with the name youtubebeat.

make

Run

To run Youtubebeat with debugging output enabled, run:

./youtubebeat -c youtubebeat.yml -e -d "*"

Test

To test Youtubebeat, run the following command:

make testsuite

alternatively:

make unit-tests
make system-tests
make integration-tests
make coverage-report

The test coverage is reported in the folder ./build/coverage/

Update

Each beat has a template for the mapping in elasticsearch and a documentation for the fields which is automatically generated based on fields.yml by running the following command.

make update

Cleanup

To clean Youtubebeat source code, run the following commands:

make fmt
make simplify

To clean up the build directory and generated artifacts, run:

make clean

Clone

To clone Youtubebeat from the git repository, run the following commands:

mkdir -p ${GOPATH}/src/github.com/Crocmagnon/youtubebeat
git clone https://github.com/Crocmagnon/youtubebeat ${GOPATH}/src/github.com/Crocmagnon/youtubebeat

For further development, check out the beat developer guide.

Packaging

The beat frameworks provides tools to crosscompile and package your beat for different platforms. This requires docker and vendoring as described above. To build packages of your beat, run the following command:

make release

This will fetch and create all images required for the build process. The whole process to finish can take several minutes.

Deploy

env PLATFORMS='linux' make release; and scp build/distributions/youtubebeat-6.5.0-linux-x86.tar.gz REMOTE_SERVER:/tmp/ELK; and ssh REMOTE_SERVER "cd /tmp/ELK; rm -rf youtubebeat-6.5.0-linux-x86; tar xvf youtubebeat-6.5.0-linux-x86.tar.gz"

Reuse

If you do reuse my work, please consider linking back to this repository 🙂