Hi, For this task you need to add a GetFile processor that will read the file followed by ConvertRecord processor. Note: GetFile has an option to keep the file after, read this option first.
Hi. Can you let me know how we can take backup of dataflow .when the nifi is restarted all data flow are lost. Is there a way to backup nd restore dataflow when the nifi server goes for restart
hi, that i not the case, if your nifi instance stoppes and you have flows in the queues, the flows will exists at nifi restart, unless your flowfile repo is set to volitile.
Might not be the right tool for cloning, but if you want if to be used for running queries and dooing insert into another db , yes - it is the tool for the job. You would need tbls with incremental keys thou
there are some approaches there as well. If you have a schema infered you can use it along with a record convertor. An easy approach would be evaluatejson and then glue the atributes as a csv
@@InsightByte thanks for answering!!! Yes, I thought about it too... Thue issue is that im reciebing a bunch of different complex arrays, so I think that building a processor for each one its not viable.
@@InsightByte i tried like instead of using generateflowfile i put getfile and instead of using logattribute i used putfile but the were always a problem and the convert record was always invalid
Thank you so very much sir, With this detail i was able to achieve the objective.
can you do the whole thing over but slower and explaining why you're doing what you're doing?
can we use get file 'cause i want to convert an already existing csv file in my pc to json file ? or we have to use generate flowfile
Nicely explained Thank you!!! I am cleared with my doubts on this topic!
Nicely explained Thank you!
i want to send my data text data to mongodb. how to parse text data into json so that i can store it in db?
hi.. do you know how to take 1 column in csv file, then create a new csv file that contain that column only. thanks
Its really Helpful can please explain how to extract the data from one oracle table and insert into another oracle table using Nifi
If the first line of my file is not 'schema' and the file is just content, how do I set it
Eg:
blablabla
Converted to
{" test ": "blablabla}"
how to use getfile processor instead of Generateflowfile??
Hi, For this task you need to add a GetFile processor that will read the file followed by ConvertRecord processor. Note: GetFile has an option to keep the file after, read this option first.
AO DBA I’m having an issue with her file I can’t define schema.name as new coloum the way you did in generate file!
It would really helpful if would you provide next to this inserting those records to a database (oracle) table
Hi, thx for the feedback, yeah i will do a short on how to insert data into Oracle or any other RDBMS
Thanks!! for the positive response
Hi. Can you let me know how we can take backup of dataflow .when the nifi is restarted all data flow are lost. Is there a way to backup nd restore dataflow when the nifi server goes for restart
hi, that i not the case, if your nifi instance stoppes and you have flows in the queues, the flows will exists at nifi restart, unless your flowfile repo is set to volitile.
Clear explanation.
Hi brother can you please tell me how can I take data from mysql and put it into another database of mysql ? I want to clone the database ...
Might not be the right tool for cloning, but if you want if to be used for running queries and dooing insert into another db , yes - it is the tool for the job.
You would need tbls with incremental keys thou
Do you have anything about json to csv????
there are some approaches there as well.
If you have a schema infered you can use it along with a record convertor.
An easy approach would be evaluatejson and then glue the atributes as a csv
@@InsightByte thanks for answering!!! Yes, I thought about it too... Thue issue is that im reciebing a bunch of different complex arrays, so I think that building a processor for each one its not viable.
@@juanpabloyela86 can you send me few examples ?
How to insert data from rabbitmq to myql?
I will post a new tutorial on how to do RabbitMQ extracts and MySQL inserts
May you also post the tutorial about streaming data to druid with Apache Nifi?
can I translate something in nifi?
doesn't work after kafka :|
how to insert CSV file into Nifi
What do you mean ?
With GetFile ?
@@asmoth360 Yes, use GetFile and the content will be inserted in the flowfile
@@InsightByte i tried like instead of using generateflowfile i put getfile and instead of using logattribute i used putfile but the were always a problem and the convert record was always invalid