Excelent video rahul, greetings from Argentina! I don't know if you are listening to suggestions for the aws series, but if is the case, i recommend you aws cdk! Thanks!
Sure am - Adding it to my list. Thank you Mariano. Any specific services/resources that you are looking at getting deployed with CDK? Vamos Argentina!! ⚽
Hello Rahul! is there any way to retrieve records from the database with list of primary keys with pagination? Please provide any solution if it is possible.
Hey Nivethaa - You might need to use the BatchGet operation and page the keys at the request side.www.rahulpnath.com/blog/dynamodb-batchgetitem-dotnet/ If you can provide more info on your case I might be able to help further.
@@nivethaaragavignesh558 Don't think Batch operations support paging, so you will have the batch the keys that you perform the request with at the client/consumer side. So if you have 100 keys and you want to show in batches of 10 you will have to do the necessary code at the client/consumer side to request with the appropriate set of keys based on the current page etc. I don't have a sample for that though. Can you explain the scenario here?
@@RahulNath My scenario is exactly what you have explained in the video for pagination, but instead of a single city name, I need to use list of city names. I understand it is not possible with query or scan request, but if you can let know if any other method to achieve this, it would be better.
ok - is it possible to limit the data set to one city name? Can the UI be modified - What problem/use case are you trying to solve here - These info might be helpful in understanding the problem better. if not you will have to either page through one city at a time or use batch (might not be ideal). Maybe you could also try creating a GSI on a different key - but these would be very dependent on the domain and the problem at hand. Hope you are able to find a solution.
Hi I want to get all items from my table via pagination. In that case i would not have any KeyConditionExpression. But when i try to run it, it throws an exception saying it expects either KeyConditions or KeyconditionExpression Can you help?
You are always there with great content. I have several doubts, is pagination not possible with high level API by any chance. Also, I am using ScanAsync with scanRequest with some ScanConditions and Limit. I am experiencing a scenario where the initial scan operation with a Limit set returns fewer items than expected, and only when I use the LastEvaluatedKey from the previous scan as the ExclusiveStartKey in the subsequent scan do I receive the remaining items that match the conditions. So basically , Limit is the number of elements scanned and not the number of elements returned to the request.
Thank you and glad you like the content. Think I mention in the video the Limit only says the maximum amount. If the object sizes in total are greater than what's allowed in a response then it stops at that count and does not read all the items to fill the Limit property. Guess that is what you are running into?
It is because, if you use ScanRequest with filter expression and limit, if say limit is 50 and the total number of records is 100, it will apply the filter expression condition only on the 50 records retrieved based on the limit and the you can only retrieve the remaining records if exist in the next request with LastEvaluatedKey as ExclusiveStartKey in the next 50 items.
Hi @rahul sir, u have prepared Awsm POC, I am surprised how u get to understand these concepts? from where u are learning. Sir if u don't mind can u please make this method more easy way if possible return data.Items.Select(x => { var doc = Document.FromAttributeMap(x); return _dynamoDBContext.FromDocument(doc); });
Glad you like it Naveen! Can you elaborate your question a bit more - What do you mean by 'make the method more easy'? That's currently the only way you can do that - You could write an extension method for it to make it more reusable.
@@RahulNath We have5 developers from external vendor, cannot give them AD access directly, so looking to create a certificate and give it to them, so that I can authenticate them before logging in to Application.
Hi Rahul, great video bro. Thanks a lot, you've helped me with dynamo pagination nightmares I've been having lol. One question though, in my project I can't access DefaultIgnoreCondition ua-cam.com/video/IXz04U73MxA/v-deo.html for some weird reason, please help?
@@ajaymanagaon Ah yes, it's different to traditionally methods we are used to with SQL Server instances. But huge benefits if you want a scalable database.
Excelent video rahul, greetings from Argentina! I don't know if you are listening to suggestions for the aws series, but if is the case, i recommend you aws cdk! Thanks!
Sure am - Adding it to my list. Thank you Mariano. Any specific services/resources that you are looking at getting deployed with CDK?
Vamos Argentina!! ⚽
@@RahulNath sorry for the delay! mmm maybe an cognito user pool or a lambda! Thx!! Vamos Argentina!!
Hello Rahul! is there any way to retrieve records from the database with list of primary keys with pagination? Please provide any solution if it is possible.
Hey Nivethaa - You might need to use the BatchGet operation and page the keys at the request side.www.rahulpnath.com/blog/dynamodb-batchgetitem-dotnet/
If you can provide more info on your case I might be able to help further.
@@RahulNath thanks for the quick reply Rahul! BatchGet is fine...but what about the page the keys in the request side? Can u elobarate a bit?
@@nivethaaragavignesh558 Don't think Batch operations support paging, so you will have the batch the keys that you perform the request with at the client/consumer side. So if you have 100 keys and you want to show in batches of 10 you will have to do the necessary code at the client/consumer side to request with the appropriate set of keys based on the current page etc. I don't have a sample for that though. Can you explain the scenario here?
@@RahulNath My scenario is exactly what you have explained in the video for pagination, but instead of a single city name, I need to use list of city names. I understand it is not possible with query or scan request, but if you can let know if any other method to achieve this, it would be better.
ok - is it possible to limit the data set to one city name? Can the UI be modified - What problem/use case are you trying to solve here - These info might be helpful in understanding the problem better. if not you will have to either page through one city at a time or use batch (might not be ideal). Maybe you could also try creating a GSI on a different key - but these would be very dependent on the domain and the problem at hand. Hope you are able to find a solution.
Hi
I want to get all items from my table via pagination.
In that case i would not have any KeyConditionExpression. But when i try to run it, it throws an exception saying it expects either KeyConditions or KeyconditionExpression
Can you help?
Figured it out. I was not providing it with the region.
Thanks anyway
@@abdulraqeeb2651Glad you figured it out Abdul!
You are always there with great content.
I have several doubts, is pagination not possible with high level API by any chance.
Also,
I am using ScanAsync with scanRequest with some ScanConditions and Limit.
I am experiencing a scenario where the initial scan operation with a Limit set returns fewer items than expected, and only when I use the LastEvaluatedKey from the previous scan as the ExclusiveStartKey in the subsequent scan do I receive the remaining items that match the conditions.
So basically , Limit is the number of elements scanned and not the number of elements returned to the request.
Thank you and glad you like the content. Think I mention in the video the Limit only says the maximum amount. If the object sizes in total are greater than what's allowed in a response then it stops at that count and does not read all the items to fill the Limit property. Guess that is what you are running into?
It is because, if you use ScanRequest with filter expression and limit, if say limit is 50 and the total number of records is 100, it will apply the filter expression condition only on the 50 records retrieved based on the limit and the you can only retrieve the remaining records if exist in the next request with LastEvaluatedKey as ExclusiveStartKey in the next 50 items.
Hi @rahul sir, u have prepared Awsm POC, I am surprised how u get to understand these concepts? from where u are learning.
Sir if u don't mind can u please make this method more easy way if possible
return data.Items.Select(x =>
{
var doc = Document.FromAttributeMap(x);
return _dynamoDBContext.FromDocument(doc);
});
Glad you like it Naveen! Can you elaborate your question a bit more - What do you mean by 'make the method more easy'? That's currently the only way you can do that - You could write an extension method for it to make it more reusable.
I'm not sure if you gonna read this, can we have one tutorial on "Certificate Based Authentication" in Azure AD?😅
Sure I’ll read Ajay 😀 What resource are you trying to connect to with cert based auth? Can you provide some more details around it ?
@@RahulNath We have5 developers from external vendor, cannot give them AD access directly, so looking to create a certificate and give it to them, so that I can authenticate them before logging in to Application.
Hi Rahul, great video bro. Thanks a lot, you've helped me with dynamo pagination nightmares I've been having lol.
One question though, in my project I can't access DefaultIgnoreCondition ua-cam.com/video/IXz04U73MxA/v-deo.html for some weird reason, please help?
Very Complicated😊
Is the video hard to understand, Ajay?
@@RahulNath I just felt it’s complex than traditional pagination methods.
@@ajaymanagaon Ah yes, it's different to traditionally methods we are used to with SQL Server instances. But huge benefits if you want a scalable database.