Hi Vishal can we not just directly add both the inspect and deidentify template in the dlp job trigger itself and give a start time and leave the end time blank so that it always keeps scanning the content for modification and keep updating the tokenization for the respective tables.. is dataflow necessary here?
Hello @TechTrapture, we can do the same but as an input to use a BigQuery table instead of a Cloud Storage csv file? Like a db to db masking, to take the info from a table, mask it and put the masked data in another table. Thanks!
@@techtrapture Thank you for your response. Can you please let me know where I can find how to do this? A video or a document? I can't find anything like this on Google
@@techtrapture But this is not just for inspecting the data? I mean I want to de-identify the data from a BigQuery table and put it in another BigQuery table. Sorry if I am not understanding well, I am a beginner. Thank you!
Hi Vishal can we not just directly add both the inspect and deidentify template in the dlp job trigger itself and give a start time and leave the end time blank so that it always keeps scanning the content for modification and keep updating the tokenization for the respective tables.. is dataflow necessary here?
Great video.
Instead of CSV, can you show using one dataset? Everything in python rather than console options.
Thanks for watching. I will share using python too soon. This was more on focusing dataflow
Hello @TechTrapture, we can do the same but as an input to use a BigQuery table instead of a Cloud Storage csv file? Like a db to db masking, to take the info from a table, mask it and put the masked data in another table. Thanks!
Yes we can do, it's most common use case. You have to use a python script with the DLP client library.
@@techtrapture Thank you for your response. Can you please let me know where I can find how to do this? A video or a document? I can't find anything like this on Google
cloud.google.com/bigquery/docs/scan-with-dlp
@@techtrapture But this is not just for inspecting the data? I mean I want to de-identify the data from a BigQuery table and put it in another BigQuery table. Sorry if I am not understanding well, I am a beginner. Thank you!
@@valentinscarlatescu deidentify also there in same document in the bottom
U should have shown creating rules in dlp
Hello Uday
Thanks for the comment.
I think you missed the previous video.
Please find the first video here.
ua-cam.com/video/XJVJo8DwSDo/v-deo.html
@@techtrapture thank you for sharing part 1 link
Nice video. can we make it in Python ?
Yes we can. Here is documentation
cloud.google.com/python/docs/reference/dlp/latest