Elastic Search Ingest pipelines (Transform | Extract data with Ingest pipeline ) Part 1

[@vivekpaliwal1876]

I have date field yyyy-mm-dd in an index..i want to reindex data to a new index where the date field is in mm-dd-yyyy....it is giving reindexing error..how to achieve that using ingest pipeline?

[@garvitkumargupta3306]

Nice video

[@TheLakeBodom]

Extremely good video.Thank you!

[@SoumilShah]

Glad you liked it!

[@joe_hoeller_chicago]

Is there a backend rest api route we can use to do this if we didn’t want to use the GUI for it?

[@logeshlogan9824]

Hi soumil "set": { "field": "field1", "value": "{{ endpoint | regex_replace('/live/disk1/[^/]+/(?[^/]+)/', '$output') }}" } .im try to get the value in field1 but getting empty reply and also if remove the regex its working fine .can u help em

[@ScottCov]

Very Helpful

[@anudeepsetty7614]

Hi Soumil, Is this process is repetitive process for reindexing consistent data or we can configure any job ?

[@aj_abdel7113]

What do you mean

[@ZTAnderson88]

Appreciated

[@vipulvaid9927]

i want to insert the ingest timestamp in my document that is already created and i added it in my ingest pipeline through dev tools query it gets added in my document but when i delete all the documents and insert again timestamp is not added.. do i need to do something as well

[@katebug03]

Do you have an example setting up a pipeline using Grok?

[@KrishnaSingh-ci9zz]

How to apply the same pipeline in existing index using Java??

[@krish-ce2sx]

Can we add custom data processor to an ingest pipelines?

[@shahanizhar828]

Hi Soumil, how do you fetch data(not logs) from MQTT broker to elasticsearch?