Ingest node: (re)index and enrich documents in Elasticsearch
Jun. 2017
Abstract
When you ingest data into Elasticsearch, you may need to perform fairly simple transformation operations. Until now, these operations had to be done outside of Elasticsearch, before the actual indexing.
Welcome Ingest node! A new type of node that allows you to do just that.
This talk explains the concept of Ingest Node, how to integrate it with the rest of the Elastic software suite, and how to develop your own Ingest plugin in practice by showing how I developed the ingest-bano plugin to enrich French postal addresses and/or geographic coordinates (for now).
This talk will also cover the reindex API which can also benefit from the ingest pipeline to modify your data on the fly during reindexing.
Video
Resources
The following resources were mentioned during the presentation or are useful additional information.