- 36
- 138 829
Shawn's Spotlight on GIS
Canada
Приєднався 16 лют 2015
Shawn's 30 years of industry experience has focused on the internet, GIS and how it all fits together in the enterprise. In his teachings at Fleming, he's found that there is a need for an understanding beyond the vender documentation. This channel provides insights into GIS, data and information sciences for new and experienced spatial data professionals covering how-to, demonstrations and other videos are to help understand how *it* really works.
Opinions, ideas and concepts here are his own and content created here is personal and do not represent any employer, government, organization or company that may be mentioned.
Opinions, ideas and concepts here are his own and content created here is personal and do not represent any employer, government, organization or company that may be mentioned.
The Secret ArcGIS Online Admin Interface
*** Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144
ArcGIS Online has a hidden REST administrative interface that gives you access to more settings than the traditional settings GUI. Learn about it here!
For those wanting to learn more about where the REST endpoints come from and the architecture of ArcGIS Online (and how it relates to Enterprise), check out this video: ua-cam.com/video/UIejoY30P28/v-deo.html
ArcGIS Online has a hidden REST administrative interface that gives you access to more settings than the traditional settings GUI. Learn about it here!
For those wanting to learn more about where the REST endpoints come from and the architecture of ArcGIS Online (and how it relates to Enterprise), check out this video: ua-cam.com/video/UIejoY30P28/v-deo.html
Переглядів: 196
Відео
Navigating ArcGIS Online like a pro
Переглядів 149Місяць тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 ArcGIS Online can be confusing to navigate, but this video will share the best way to get started and use items like a pro. Both new users and those that use ArcGIS Online regularly will benefit from the core concepts introduced by Shawn. Watch and become more productive and really understand Items, Hosted F...
The essentials of ArcGIS Pro Projects.
Переглядів 95Місяць тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 Getting started with ArcGIS Pro can be confusing, particularly what a Project is and how to manage them. This provides a best practice to get started for new (or seasoned) users of ArcGIS Pro.
2024 GIS Collaborative Project Preview Videos
Переглядів 4925 місяців тому
The collaborative project completed by Fleming Post-graduate GIS students helps tie the academics learned in the previous 8 months to what industry needs. These 16 projects for 2024 are completed by students for academic credit and fulfil the need of an industry partner. Watch as each group gives a 1 minute overview of their 2024 project. You can meet these groups in-person at the Fleming Frost...
Securing your Data using ArcGIS Online Views
Переглядів 2148 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 Feature Layer views are a great way to secure data hosted in ArcGIS Online. You can select specific fields, records or even limit the data spatially to an extent. Follow this short view to learn how it works.
Hosting a personal website on GitHub for free!
Переглядів 1,2 тис.8 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 GitHub Pages allows you to create and host your own webpage for no cost. This short video shows you how to make it work, including some tricks and tips on the default repository at GitHubUsername.github.io, where GitHubUsername is your username! Github documentation for these steps: docs.github.com/en/pages/...
Using ChatGPT to code custom ArcGIS Online Applications, step-by-step!
Переглядів 9839 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 Using Generative AI (ChatGPT v4) you can provide a map service and, through some specific prompts, you can create a fully-functional webpage application for your published map service. This quick overview provides how I create the application at Final Application: simplyhelp.github.io/genaidemo1/mainfinal.ht...
Using ArcGIS Server map services in ArcGIS Online
Переглядів 1,6 тис.9 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 ArcGIS Server is part of ArcGIS Enterprise, but can be used by itself (unfederated). This video details how to use map services published from ArcGIS Server in ArcGIS Online as items, including how to secure them so no one using it will see your actual server name.
Getting ArcGIS Server running on Google Cloud Platform (Bypassing the Esri bug!)
Переглядів 4149 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 Installing ArcGIS Server on Google Cloud Platform will fail without a fix. This video covers that fix, as well shows the basics of using Google Cloud Platform, Remote Desktop, and some general tips/tricks of using cloud Virtual Machines to try software out. GCP ArcGIS Server Fix documentation: github.com/sha...
Reduce ArcGIS Online credit usage by having Geoserver host your data!
Переглядів 1,3 тис.9 місяців тому
Help support this free channel by buying me a coffee: buy.stripe.com/fZe29Y12KakuaWY144 ArcGIS Online charges for any data stored within its datastore. The vendor will recommend ArcGIS Enterprise as a way to move data to on-premise. But there is a way you can do this without any additional license costs. You can use your own server to store the data and have Geoserver share that data as a WFS t...
ArcGIS Enterprise - How Services and Items REALLY Work, and administrative GUI Tour
Переглядів 2,3 тис.9 місяців тому
Following up with my Basics Tour, this ArcGIS Enterprise video goes through how items really work, the components that make up the Portal, and shows the connections between the different components that make up the "Base Deployment".
Learning JavaScript: Using Libraries focusing on jQuery
Переглядів 232Рік тому
jQuery is a mature JavaScript library is a way to navigate the Document Object Model (DOM) efficiently. There are many other libraries out there and can help you "glue" things together to build solutions.
Using VS code with Github
Переглядів 476Рік тому
This is a demo on using VS Code with GitHub and is a basic introduction to working as a team contributing to the same GitHub repository. It is used for Assignment 3 in Fleming College's web course as part of the Post-graduate GIS programs.
Exploring the Android GNSS (GPS) device chips using the app GPSTEST by Barbeau
Переглядів 1,4 тис.Рік тому
Global Navigation Satellite Systems (GNSS/aka GPS) are everywhere in our tech. Surveyors use GNSS to get highly-accurate points for use in legal parcel cadastral mapping. But what can you squeeze out of your phone or consumer-GPS? This video demos the open-source android app GPSTEST (github.com/barbeau/gpstest for full documentation, and play.google.com/store/apps/details?id=com.android.gpstest...
Learn SQL: Solving 1NF problem using SQL
Переглядів 287Рік тому
Solving the 1st Normal Form problem using SQL is not hard, but does require multiple steps. This short video details how to do that.
Learn SQL: Converting non-date fields to Date/Time format
Переглядів 497Рік тому
Learn SQL: Converting non-date fields to Date/Time format
Learn SQL: 3 Building Queries in MS Access
Переглядів 39Рік тому
Learn SQL: 3 Building Queries in MS Access
Learn SQL: 2 Importing a CSV into MS Access
Переглядів 35Рік тому
Learn SQL: 2 Importing a CSV into MS Access
The Hidden Settings in MS Access: Use a more common SQL syntax!
Переглядів 60Рік тому
The Hidden Settings in MS Access: Use a more common SQL syntax!
Learn SQL: 1 Getting Started with MS Access
Переглядів 111Рік тому
Learn SQL: 1 Getting Started with MS Access
Understanding ArcGIS Survey 123 Connect (how it really works)
Переглядів 17 тис.2 роки тому
Understanding ArcGIS Survey 123 Connect (how it really works)
Publishing and Registering data in Esri ArcGIS Server (unfederated) using ArcGIS Pro
Переглядів 11 тис.3 роки тому
Publishing and Registering data in Esri ArcGIS Server (unfederated) using ArcGIS Pro
Obtaining an SSL certificate from Let's Encrypt
Переглядів 14 тис.3 роки тому
Obtaining an SSL certificate from Let's Encrypt
Viewing the Demo Data included with Geoserver (3 of 4)
Переглядів 1,4 тис.4 роки тому
Viewing the Demo Data included with Geoserver (3 of 4)
Configuring an initial install of Geoserver to work with IIS (2 of 4)
Переглядів 4,7 тис.4 роки тому
Configuring an initial install of Geoserver to work with IIS (2 of 4)
As someone who has only worked with desktop deployments of arc, this was super informative. I have an interview this week for a GIS solution engineer and they only use enterprise. Might have saved my skin, thanks dude!
I'm glad it was useful. Let me know how your interview goes! Good luck.
Hi Shawn, this is an amazing video! I have a question and wondering if you know the answer. Around 28:58, you mentioned the 'label' and 'name' fields, and that the final export to the database would store data as 'name.' However, when I export, it only shows the 'label' field, which includes some duplicates. Is there a specific setting or step I might be missing to ensure the export uses the 'name' field instead?
Survey 123's interface is a subset/modified version of the main ArcGIS Online interface. You have more options to export by going to the ArcGIS Online hosted feature layer itself and exporting the data from there. Saving as a File Geodatabase would provide the most flexibility as you can then use ArcGIS Pro to extract the data as you want, OR use a GeoPackage and do the same with open-source QGIS.
Thank Shawn for an interesting video. you explain how things are logically and physically connected. I work with a federated AGE and I always wonder what really happen under the hood when I publish a hosted feature service, how ArcGIS server creates REST endpoint for it... if you have time, I would like to watch how you explain it. And although the Datastore is a blackbox now, we would like a readonly permission to read data directly from it, hope you will talk about it one day. Appreciated!!!
Happy to help! Let me know if you are interested in personal mentoring/training to address what you are asking. shawn@simplyhelp.ca
if my map has a python script to consume an APi, the script will be work when publish the map?
Publishing a map disconnects it from anything like python scripts. The data would be "uploaded" to the server, unless registered. If registered, that python scripts acting in ArcGIS Pro would continue to update the shared data store used in the service. Happy to help with mentoring/training services if you want to learn more. Shawn@simplyhelp.ca
Hi Shawn, Thank you for the videos! I really like them. I only wanted to ask: "How they estimate the necessary number of license cores needed for Enterprise Server?" Thank you for your time
There is no easy way to do this. Too many variables for each condition. I can help estimate this as a consultant if you want to reach out as it would involve an assessment of needs/etc.
@@shawnsspotlightongis Thank you for the answer! Unfortunately, I don't have necessity now. Just curious how they do it.
Hi Shawn, excellent clarification. When I am trying to publish, I am receiving an error message, "The ArcGIS GIS server role is not licensed on the ArcGIS Server". Could you please explain why am I having this issue and how this could be resolved?
Sounds like a licensing issue or targeting the AGOL REST endpoint and not an actual ArcGIS Server.
Excellent explanation!
Glad it was helpful!
We are trying to move from ArcGIS to ArcGIS Pro and also changing to Enterprise environment. And this video has helped me a lot in understanding the concepts. Thank you, Shawn.
Glad it helped! Thanks for the message and let me know if I can help in your org.
Shawn -- Great video and well presented. Thank you! We have an ArcGIS Enterprise and AGOL organization, but for the sake of cost we are thinking of moving towards either full Enterprise by itself or a hybrid server + AGOL. Besides allowing custom web tools in web applications and customizing experience builder etc using javascript sdks, what in your mind do you see us missing out on by using AGOL essentially as the portal and datastore instead of ArcGIS Portal?
I think it comes down to licensing and your data on-prem as the main reasons to consider AGE vs AGOL! AGE is more expensive, time consuming to manage etc. The hybrid approach using ArcGIS Server alone with AGOL bridges some gaps with limitations, but for most is enough.
That is a great video. Thank you so much.
Glad you enjoyed it.
It's so sad that the GIS program is suspended. I was excited to start in Sept 2024. I hope it comes back!
Thanks for the comment. I hope too that it comes back.
We are going to move from an ArcGIS Server environment to an Enterprise environment. This video made it much simpler to understand how everything interacts with each other and what is needed to complete the upgrade. Thank you so much for sharing.
Glad it was helpful!
I am eagerly anticipating the opportunity to know more about the projects from all participating groups. The final screen evoked some strong emotions. :(
thank you so much!! this was a fantastic explanation.. thank you so much. ❤
Glad it was helpful!
An excellent tutorial! really really thank you!!! its a really great video! congrats
Thank you! I appreciate your comment and glad you found it useful. I hope to publish more as I determine what is needed!
These videos are very good. I watched the first one for Enterprise as well. Do you have a full course on Enterprise ?
Not a formal course, but do provide consulting through simplyhelp.ca on Enterprise.
wonderful tutorial thank you for sharing!!
Thanks for watching!
Secondly: How does Survey123 deal with monitoring? So, with monitoring I mean revisit a site and add (not modify) information for that specific site that you mapped in the past. E.g. Tree A has a height of 1 meter in 2022. Then you want to want to map the height of Tree A in 2024, so creating a time trend of the tree height. Any experience with that?
This requires you to model the data in a way that you are adding a new record each time for the feature you are monitoring (this would be in its own table/hosted feature layer, separate from the monitor table). Then have a data model in AGOL that provides the links to this. It is not an easy use case. Field Maps might be an easier solution.
@@shawnsspotlightongis I already thought so. Yes, Field Maps could do the job, but at first glance, Field Maps has a much more technical UI than Survey123. So I am afraid Field Maps is less useful for development countries, where many (older) enumerators working in the landuse sector are not that tech-savy... That is why I am more charmed by Survey123 (more user friendly). It seems however that ESRI just used the functionality of ODK, created a good looking GI around it, but has not been able to tackle the monitoring issue (as also exists with ODK) and creating relational databases. That is a bit of a bummer and also a bit of a surprise that ESRI's solution do not cover this, as monitoring is KEY nowadays (so beyond the 1 time mapping). Anyway, thanks for the response!
When you are in the field with no (Wifi/GSM) connection and your device does not have a basemap layer of the area where you are, are you still able to record areas and GPS points? In many development countries this is the case. And also, not every (older) device is able to store a detailed basemap layer that is covering the globe(?). So you always have enumerators that go into the field without having the base layer of the area they need to map. How does Survey123 deal with these realities?
You can configure Survey 123 to go offline. GPS works without data connection, it only requires clear line of sight to the satellites.
@@shawnsspotlightongis Thanks for clarification.
*promo sm*
Can we edit data in the View layer (given the permission to)? If it can, will the edit appear in the source Hosted feature layer?
Yes you can edit them! The view always points back to the original hosted feature layer for all changes or updates.
Thanks sir Can chane data dirctory od geoserver for users hard drive pc (Geoserver install on windows server)
Hi Shawn, Is there a demo version of ArcGIS Enterprise to try out like a trial version ? Also where did you install the enterprise server in this video? is it on your desktop or some other server?
You must be licensed to install it. You can purchase a developers license to get the licenses for what you suggest, or perhaps join a college to learn and gain access to their licensing. My college (Fleming College) does have post-graduate GIS programs you can take from anywhere and would give you access. This is a demo machine for development.
These videos are so helpful. Please keep making more :) A quick question, do you know if the view layer can still be used within web-maps/apps to be edited by the user even with these filters on? For example, a fire hydrant map that only shows hydrants within a certain zone (with this filter enabled) could I still edit those hydrants and would the hydrant field edits be represented in the original dataset? Thanks! Luke
Yes! You can edit through AGOL views and it will modify the main dataset. Some settings must be made on the hosted feature layer that the feature layer view was created from, but general editing is possible without issue!
Can I import my form data for mass upload in Survey123?
I'm not sure what you mean by mass upload form data, are you looking to import a CSV file into Survey 123 as an example? That is not an out of the box option nor really a use case for the product. FME Server might be a better option for mass upload work.
Hi Shawn, that is a good trick to host data on ArcGIS online without using credits for storage. I have been trying it from my end but have not been successful. When I add the item through URL option in AGOL, it does detect the type as WFS but when i click next an error is displayed - "This version of WFS is not supported". Can you please let me know what I missed? I followed every step from you video but still getting the error. Please help
GeoServer supports versions 2.0.0, 1.1.0, and 1.0.0 for WFS, so you might be using 1.0.0. The URL itself says which version is being used, so try generating a new URL in the preview of your service using a different version and try that.
@@shawnsspotlightongis am kind of lost out here now. How do i generate a new URL for the service?
Hi Shawn, could you please explain the benefit of using Arcgis online here instead of a federated portal. And to make services available, does this mean Arcgis server has to be accessible by arcgis online?
This is to fill the gap between ArcGIS Online and a full ArcGIS Enterprise deployment, as well avoids per-user licensing in ArcGIS Enterprise. ArcGIS Server is licensed per install. Combining ArcGIS Server and ArcGIS Online gives the best combination of SaaS and on-prem.
Great work Shawn!
Amazing!! shawn You just Rock 👌👌👏👏👍👍
Thanks so much!!
@shawn, can you please do a video to register a point shapefile where my source is reading x,y table from oracle table connection, convert to shapefile, then publish to server, this oracle table gets periodically updated and my shapefile should reflect the new changes on the server, which then can be consumed on enterprise portal and online. I appreciate your great help in this regard.
I'd create a view in Oracle to make the X and Y spatial, then simply share that as a Map Service via a database connection right to ArcGIS Server. No shapefile needed. Or use GDAL to export it as a shapefile, which looks something like ogr2ogr -f "ESRI Shapefile" my_shapefile.shp OCI:user/password@service -dialect "OGRSQL" -sql "SELECT *, OGR_GEOM_FROM_TEXT('POINT(' || LONGITUDE || ' ' || LATITUDE || ')') as geom FROM my_table" -overwrite -a_srs "EPSG:4326"
Excellent!👌👌👏👏
Thank you!
Great video! Very interesting and useful content!
Glad you think so!
Great video
Thanks!
Don't you have to add Geoserver as a Trusted Server in ArcGIS Online and enable CORS in Geoserver to add a service to ArcGIS Online?
You do need CORS enabled, but that isn't difficult in Geoserver (just uncomment some lines). Nothing needs to be done in ArcGIS Online and you can just be a user to add an item pointing to your Geoserver URL.
shawn thanks a lot for this awesome video!! would you please show how to add a Waze layer to AGOL
Waze as in traffic tracking? Esri has a layer for purchase on this. www.esri.com/en-us/arcgis-marketplace/listing/products/06723334075647738cec1259078c4dbe
Shawn Wow! amazing feature being demonstrated here!!Thanks a Lot. 👏👏👏👌👌👌
Your courses and videos are so good, however I fail to trutly apply all of this to my job (most likely my fault) I have so many questions, how to create an enterprise geodatabase based on a UML model, how to ensure my firewall connections are properly set up in my company to access them correctly, just about everything else really of the application aspect of all of this. Do you think there's a course of some kind that can help me from the basics to build up from there? I'm really used to just the basic aspect of GIS (digitizing and basic use of tools already created) but I wanna make the next step in trutly becoming a gis analyst. Thank you for your content
Great questions! As a GIS professional we need to know IT, Geography and database industries together. Here are some simple answers: Why are you trying to use UML with an Enterprise Geodatabase, it is its own "Schema" so you can't really do that. But you can design it using tools like UML but likely need to manually create the feature layers. Applications are another area of expertise. What I recommend is either taking a GIS Program (my college has a great one at flemingcollege.ca/programs/geographic-information-systems-for-analytics) or hiring a consultant (reach out to me using the links at simplyhelp.ca/ if that is what you wish).
Thanks nice information
Thanks nice information
Thanks for liking
This is great thank you, the diagram and the way you explained everything was great.
Glad it was helpful!
Thanks, very helpful.
Thanks for this detailed introduction to Survey123. I have an existing database of water quality monitoring results collected by volunteers, which I can download into XLS files. The data was collected using an obsolete custom application which I am replacing with Survey123. Do you know of a way to show the historic data (which are associated with specific locations) along with the new data being collected in the surveys? Thanks!
Survey123 is just a data collection app, it isn't meant to browse data past collected. You would need to use a dashboard or other web app from Esri to navigate pre-existing data.
Is there a way to snap to a point on a map in the survey when using Survey 123 Connect? I know the web designer has that capability but i am struggling with connect.
If you can do it on the web version, you can do it in the connect. Easy hack here--create it using the web version, then use Survey 123 Connect to download the survey and edit it! That way you can "see" how they did it and duplicate it.
I have 2 layers (A, B) which has relationship by storing object id of layer A in layer B field. by using REST API can i get a collection of layer A with related records of layer B?
Relationships are possible, but not an easy task and haven't worked on it. I recommend keeping it simple in Survey 123, OR use Field Maps which is more native to the Esri ecosystem and can do more with the geodatabase.
where can i get those slides or powerpoint presentation ? This is the absolut best explanation of ArcGIS Enterprise, ArcGIS Online, their diffrences and when to use which i have ever seen. But the listener need have some Foundation on ArcGIS in overall. Because i listened to this a year ago and didnt understand anything. Now when i have been working with Esri products for almost1,5 year, everything was clear and understandable.
Hi Shawn! This a great video and everything is clearly expressed and correct. Have you considered creating a blog and posting this in Esri Community for Survey123?
Thank you for the comment! I'll have to take a look if there is an opportunity for that! Feel free to share the video if you see someone on the esri community that might benefit from it.
amazing content
Thanks!
thank you!
Why is that ESRI over complicates everything? Great video describing everything tho.
There is a balance between ease-of-use and technical capabilities that is hard to get right. I hope my video provides a little more clarity!
Once again great stuff :)
Thank you! Cheers!
Thanks for a great overview of Survey123 :)