101. Copy activity - Pagination rules - When API response have URL for next page

In this video, I explained about how to implement pagination rules in copy activity when API response has URL for next page in Azure Data factory or Azure Synapse Analytics.
Link for PySpark Playlist:
• 1. What is PySpark?
Link for PySpark Real Time Scenarios Playlist:
• 1. Remove double quote...
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link to Azure Synapse Real Time scenarios Playlist:
• Azure Synapse Analytic...
Link for Azure Data bricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure Logic Apps playlist
• 1. Introduction to Azu...
#azure #datafactory #azuredatafactory #azuresynapse #wafastudies #pipeline #adf #dataengineering #azuredataenginnering #synapseanalytics #datafactory

[@ikeguti3]

this is exactly what i was looking for! You are the best🎉

[@Umerkhange]

Please make a video where you explain other variables along with use cases like Query Parameters,offset etc.

[@MarathiMoviesZone]

"info": {
"per_page": 200,
"count": 200,
"page": 1,
"sort_by": "id",
"sort_order": "desc",
"more_records": true
}
how to do pagination rule for above example.

[@mateen161]

Nice one.Thank you!

[@WafaStudies]

Thank u

[@raulpinto2436]

Thank you for sharing. Was exactly what I needed

[@azurecontentannu6399]

Very useful.. Thank you for sharing 😊

[@WafaStudies]

Thank u ☺️

[@arundhatisen1053]

Hi can you show a example where is copy data to rest api endpoint using rest connector in sink

[@MrSparkefrostie]

Any chance you have a video up that covers collections inside of collections?

[@pratikutture2109]

Thank You

[@WafaStudies]

Welcome

[@manasa06m]

Hi @WafaStudies Can we pull the API data through copy activity and load it into any datawarehouse directly instead of writing into blob. Is that possible?

[@WafaStudies]

U can. Instead of adls gen2 dataset, ise dataset which points to ur data warehouse table

[@manasa06m]

@@WafaStudies Thank you 😊

[@Daily_motivations_telugu]

Hi bro...I did same. Able to read the all pages data. When I'm doing flattening each page of information comeing like one row.
But I need all pages of information in single array.
Please do one vedio on this

[@petkopopov6385]

ty man

[@nareshkumar344]

Can we use odata api also for pagination