-Xmx128gb -Xms128gb

adding more memory to my brain!

Index Twitter on Found

| Comments

Some months ago, I published a recipe on how to index Twitter with Logstash and Elasticsearch.

I have the same need today as I want to monitor Twitter when we run the elastic FR meetup (join us by the way if you are in France!).

Well, this recipe can be really simplified and actually I don’t want to waste my time anymore on building and managing elasticsearch and Kibana clusters anymore.

Let’s use a Found by elastic cluster instead.

Importing From a Database Without a Database

| Comments

Recently, I got a database MySQL dump and I was thinking of importing it into elasticsearch.

The first idea which pops up was:

  • install MySQL
  • import the database
  • read the database with Logstash and import into elasticsearch
  • drop the database
  • uninstall MySQL

Well. I found that some of the steps are really not needed.

I can actually use ELK stack and create a simple recipe which can be used to import SQL dump scripts without needing to actually load the data to a database and then read it again from the database.

Let’s do it!

Reindex Elasticsearch With Logstash

| Comments

Sometimes, you would like to reindex your data to change your mapping or to change your index settings or to move from one server to another or to one cluster to another (think about multiple data centers for example).

For the later you can use Snapshot and Restore feature but if you need to change any index settings, you need something else.

With Logstash 1.5.0, you can now do it super easily using elasticsearch input and elasticsearch output.

Let’s do it!

Devoxx France 2015

| Comments

I gave recently a talk at Devoxx France 2015 with Colin Surprenant and I’d like to share here some of the examples we used for the talk.

The talk was about “what my data look like?”.

We said that our manager was asking us to answer some questions:

  • who are our customers?
  • how do they use our services?
  • what do they think about us on Twitter?