Lucia S
Lucia S
  • 15
  • 30 712
Deploy Cortex Data Foundation with your own data
In this video, Lucia Subatin shows us how to execute the deployment of Cortex Data Foundation after all prerequisites are met. The previous videos in this playlist explain the prerequisites in detail. After Cortex Data Foundation is deployed, you can explore additional offerings from Google Cloud Cortex Framework.
Full playlist: ua-cam.com/play/PL-yfhks0lM0tFbWvwAUSWmDN6oO64jA8T.html
Cortex Data Foundation documentation: github.com/GoogleCloudPlatform/cortex-data-foundation
Cortex Application Layer: github.com/GoogleCloudPlatform/cortex-applayer
00:04 Prerequisites from previous videos in this playlist
00:27 Cloud Build command
00:53 Check deployment progress
01:20 Understand execution in Cloud Build
01:30 Execution with turbo mode = false
01:49 Execution with turbo mode = true
02:07 Successful deployment
02:12 Sample deployment error due to missing field
02:50 Saving customizations for future upgrades
03:10 Contacting the Cortex Support team
03:20 After a successful deployment fo Cortex Data Foundation
Переглядів: 184

Відео

How to configure your deployment in Cortex Data Foundation
Переглядів 2137 місяців тому
Learn how to configure the deployment and different options in config.json. Next video: Deploy Cortex Data Foundation with your own data ua-cam.com/video/Ppmg1olGSBI/v-deo.html Playlist → ua-cam.com/video/n1d654fkPjY/v-deo.html 00:05 - Intro 00:33 - Clone the GitHub repository 01:08 - Understand config/config.json 01:53 - Turbo Mode 02:46 - Location options 03:35 - Data Mesh options 04:00 - SAP...
How to Deploy Cortex Data Foundation - Deployment Prerequisites
Переглядів 3377 місяців тому
In this video, Lucia Subatin goes through the components, project and dataset structure and other prerequisites to successfully deploy Cortex Data Foundation for productive use. Links: Google Cloud Cortex Framework GitHub repository → goo.gle/cortex-github More on Data Pipelines → ua-cam.com/video/IPKcdJ-Xyyc/v-deo.html Questions to think about before deploying →docs.google.com/spreadsheets/d/1...
Cortex Data Foundation - How to run a demo deployment
Переглядів 5277 місяців тому
This is the first video of a series explaining how to deploy Cortex Data Foundation. Lucia Subatin covers the quick deployment of SAP, Salesforce, Marketing and more through the GitHub button for demo deployment. Links: Google Cloud Cortex Framework GitHub repository → goo.gle/cortex-github Introduction to Google Cloud Cortex Framework → goo.gle/CloudCortexData Next video → ua-cam.com/video/fUu...
[VERSIONES VIEJAS] Cómo implementar la Data Foundation para Google Cloud Cortex Framework
Переглядів 1,3 тис.2 роки тому
Hola! Este video aplica a versiones anteriores a 4.0 de Cortex Data Foundation. para un vieo actualizado, ver esta playlist: ua-cam.com/video/n1d654fkPjY/v-deo.html GitHub Repository, Instructions and commands: github.com/GoogleCloudPlatform/cortex-data-foundation Mando Checker Repository: github.com/fawix/mando-checker What you should know before deploying: - Google Cloud Platform fundamentals...
[OLD] How to deploy the Data Foundation for the Google Cloud Cortex Framework
Переглядів 4,3 тис.2 роки тому
This video applies to older versions of Cortex. Please head to the new playlist for releases 5.0 and higher: ua-cam.com/video/n1d654fkPjY/v-deo.html GitHub Repository, Instructions and commands: github.com/GoogleCloudPlatform/cortex-data-foundation Mando Checker Repository: github.com/fawix/mando-checker What you should know before deploying: - Google Cloud Platform [fundamentals](www.coursera....
SAP HANA, BigQuery, Machine Learning and Looker - Real time integration demo
Переглядів 2,7 тис.4 роки тому
This is a demonstration of how the integration between SAP HANA, Google BigQuery and Looker can unlock the value of machine learning for customers and provide the business with intelligent insights. Implement data models on top of replicated data from SAP with Cortex Data Foundation. Learn more about modelling SAP data in BigQuery: ua-cam.com/video/n1d654fkPjY/v-deo.html Replication tool is the...
SAP HANA, express edition + XS Advanced Application
Переглядів 3,3 тис.4 роки тому
Intro video in tutorial with different options on SAP HANA, express edition
SAP HANA, express edition - Server Only
Переглядів 4,9 тис.4 роки тому
SAP HANA, express edition - Server Only
Celebrating SPS04 on HANA Express
Переглядів 6084 роки тому
When you leave Lucia alone in the office on a Friday
SAP HANA and Google Home integration for SAP TechEd 2019
Переглядів 764 роки тому
Built on SAP HANA express edition running on Google Cloud Platform using the Cloud Application programming model and calculation views using fuzzy search. Dialogflow fulfillment using Google Cloud functions
SAP HANA on Kubernetes with SQLPAD
Переглядів 4645 років тому
Recording this tutorial anyone can follow: developers.sap.com/tutorials/hxe-k8s-advanced-analytics.html
SAP HANA XS Advanced Development - debugging xsjs and node.js
Переглядів 5 тис.7 років тому
This video will demonstrate how to debug XSJS and node.js in the SAP Web IDE for SAP HANA. This tutorial is using a script created in the following tutorial: www.sap.com/developer/tutorials/xsa-xsjs-xsodata.html The instance used in this video is an SAP HANA 2.0, SPS01.
SAP HANA, XS Advanced - Dimension Calculation Views
Переглядів 4,2 тис.7 років тому
This video is a part of the XS Advanced tutorial series in developers.sap.com. It demonstrates how to create a Calculation View of type Dimension using the SAP HANA Interactive Education data model. Prerequisite for this tutorial: www.sap.com/developer/tutorials/xsa-import-shine-data.html SAP HANA 2.0, SPS1
Hey, Google, let me talk to HANA
Переглядів 2,5 тис.7 років тому
Hey, Google, let me talk to HANA

КОМЕНТАРІ

  • @manzar905
    @manzar905 25 днів тому

    hana express edition-sap control request failed - this error is coming when IP address in ecilipe

  • @goodmanshawnhuang
    @goodmanshawnhuang 5 місяців тому

    Hi Lucia, thanks for sharing this. actually, we tried to deploy Cortex data foundation with our own data which has been replicated through SLT , if we set the type to "view" instead of "table" in reporting_settings_ecc.yaml, all data in dataset "REPORTING" look good except the performance is bad, but if we switch back to type "table" (we don't use Cloud Composer yet), all the tables in "REPORTING" are blank, is this the expected behavior? do we have to have Cloud Composer to run the DAGs to even initialize the data? thanks in advance.

    • @LuciaSubatin
      @LuciaSubatin 5 місяців тому

      Hi Shawn, yes, the DAGs should populate the tables. You can take the SQL files and schedule them with any other scheduler, including dataform. It doesn't have to be Composer, but something needs to run those SQL statements periodically for the tables to refresh. That's assuming you deleted the reporting dataset before re-deploying after changing from view to table. Also, depending on the sequence, you may also want to schedule some SQLs to run only after a specific dependency has been successful. This is a manual modification for the Composer DAGs too.

    • @goodmanshawnhuang
      @goodmanshawnhuang 5 місяців тому

      @@LuciaSubatinGreat thanks for your quick response, appreciate it.

  • @milicasudar7353
    @milicasudar7353 6 місяців тому

    Hi, thanks for videos! I have a question initial import of sap data like batch import is not covered with Cortex framework right? So initial integration with sap needs to be done before using cortex(e.g. with big query connector, cloud data fusion..) and than use cortex for cdc? Thanks in advance! :)

    • @LuciaSubatin
      @LuciaSubatin 6 місяців тому

      Hi, thanks for watching! Yes, the assumption for SAP is that data is already replicated either in RAW with the timestamp and operation flag, or in CDC with merge. There's no specific choice of tool, as long as the tables are landed with the same field names and formats as in the original tables in SAP ECC or S/4 HANA.

  • @mohtalha
    @mohtalha 7 місяців тому

    In the new version of the github repo, I did not find the sets.yaml file. Has it been deprecated? What is the alternative?

    • @LuciaSubatin
      @LuciaSubatin 6 місяців тому

      A lot has changed in a year, so we removed this video from the README. Hierarchies can now be flattened with a newly released set of scripts you'll find here: github.com/GoogleCloudPlatform/cortex-reporting/tree/b05a3345d55d5e196d8d636daf0c81541d0604e7/local_k9 The good thing about this new approach is it doesn't require configuration. If you want to learn exactly when this changed, I'd recommend going to the release notes. There's a new playlist that will be linked as soon as it's complete here, but maybe it helps: ua-cam.com/video/n1d654fkPjY/v-deo.html

    • @mohtalha
      @mohtalha 6 місяців тому

      @@LuciaSubatin Thank you. I was able to actually check the old tags. and project contents. There is reference to sets.yaml in the latest readme too. That was the confusion. I will go through your recommended document,

  • @goodmanshawnhuang
    @goodmanshawnhuang 7 місяців тому

    Hi Lucia, it's great job to have developed this Cortex framework. With our real data having been replicated into Bigquery, we deployed the Cortex framework a few months ago, and we noticed there are some new releases, what's your suggestion if we would like to patch the new features of the new release without risking our current deployed one? thanks a lot in advance. - Shawn

    • @LuciaSubatin
      @LuciaSubatin 7 місяців тому

      Hi Shawn, thanks! Hopefully you'll find this helpful: github.com/GoogleCloudPlatform/cortex-data-foundation/blob/main/docs/upgrade_recommendations/upgrade_recommendations.md It explains how to prepare to merge changes as they are released.

  • @mohtalha
    @mohtalha 7 місяців тому

    Any guidance on using SAP Datasphere to replicate SAP OTC, PTP modules directly from S4HANA to GBQ cortex data foundation? Should the tables be exact replica in definition at Hana and target GBQ? Please advice

    • @LuciaSubatin
      @LuciaSubatin 7 місяців тому

      Hi @mohtalha, the models in Cortex Data Foundation assume the tables will have the same names and formats as in the source. Cortex is agnostic in terms of the replication tool and intently avoids dependencies on transformations or business logic in the source or the replication tool, so customers can choose the tool that works best for them. In other words, as long as the same types and names are there, the models will work, whether you use datasphere or a spreadsheet to move the data around. If you wanted to add more tables and have the CDC generator create the MERGE script for you, all you'd need to do is declare the table in the cdc_settings.yaml and the script will pick the definition up from dd03l. Then you'd need to add your own JOINs or SQLs in the reporting layer if you wanted the deployer to manage them too. I normally do not recommend replicating pre- aggregated models (e.g., ODP extractors or CDS views) unless they are mimicking raw tables and you have no other way. Does that help?

  • @samuel.lineadirecta
    @samuel.lineadirecta Рік тому

    Buenas tardes Lucia, tengo una pregunta, nosotros intentamos implementar Cortex usando el replicador "BigQuery connector for sap SLT" pero tuvimos errores de implementacion, estos errores sugieren que no tenemos la suficiente liciencia en nuetro sistema SLT. Que tipo de licencia SLT se requiere para llevar acabo este enfoque. Mil gracias. Saludos

  • @naveenkumarkc2141
    @naveenkumarkc2141 Рік тому

    Do you have any Playlist for HANA XSA

  • @adrianc213
    @adrianc213 Рік тому

    Hi Lucia, great information. Do you know if data replication can be accomplished for “SAP Business By Design” using Cloud Cortex? My understanding is that Odata is available.

  • @espartacogonzalez7874
    @espartacogonzalez7874 Рік тому

    Hi Lucia! Thanks for sharing this valuable video. I successfully deployed Cortex Framework with this this tutorial. However, I am going to deploy Cortex Framework 3.0 I would like to validate with you if the procedure is different. Are you planning to release the video for Cortex 3.0? Thanks you so much!

    • @LuciaSubatin
      @LuciaSubatin Рік тому

      Hi Espartaco, thanks for watching. The procedure is the same, we keep the cloud build backwards compatible always. I would recommend taking a look at the readme to understand the new options and features introduced in 3.0 though. Good luck! 🦄

    • @espartacogonzalez7874
      @espartacogonzalez7874 Рік тому

      @@LuciaSubatin Thank you for your quick reply. I will follow your recommendation. On the other hand, Could I have deployed the previous Cortex Version and the Cortex 3.0 in the same project with the same BQ instance? I think so. But, I want to confirm with you if we could have multiple Cortex deployments on the same project.

    • @LuciaSubatin
      @LuciaSubatin Рік тому

      @@espartacogonzalez7874 Yes, you can multiple deployments per project, just keep an eye on the names of the datasets so they don't overlap. If you are using our test data, I'd recommend deleting raw and CDC before deploying if using the same dataset between releases.

  • @thorstenstaerk9200
    @thorstenstaerk9200 2 роки тому

    great video :) Do you have any pointers how to do the replication to BigQuery?

    • @LuciaSubatin
      @LuciaSubatin 2 роки тому

      Thanks, Thorsten! You'll find the options in cloud.google.com/solutions/sap/docs/sap-data-integration-guides and a video about one of those options, the BigQuery Direct Connector, here: ua-cam.com/video/IPKcdJ-Xyyc/v-deo.html

  • @pms_code
    @pms_code 2 роки тому

  • @limjix
    @limjix 2 роки тому

    Hello, I'm curious, what do you use to replicate the tables from HANA to bigquery?

  • @ln3346
    @ln3346 3 роки тому

    Any idea how can I debug through Eclipse?

  • @srinivasareddybuthukuri6269
    @srinivasareddybuthukuri6269 3 роки тому

    Useful information thanks

  • @vineetasinha
    @vineetasinha 4 роки тому

    Hey, where is the link in the description you mentioned about cloud deployment?

    • @LuciaSubatin
      @LuciaSubatin 4 роки тому

      Hey! Yes, here: developers.sap.com/tutorials/hxe-database-xs-advanced.html

    • @vineetasinha
      @vineetasinha 4 роки тому

      @@LuciaSubatin Thanks a lot...

  • @vamsi8558
    @vamsi8558 4 роки тому

    For practice in laptop for which size RAM would be suggest to take?

    • @LuciaSubatin
      @LuciaSubatin 4 роки тому

      For the server-only flavor the official minimum is 8GB. I'd recommend 12gb.

  • @chloehii7633
    @chloehii7633 6 років тому

    Hi Lucia, How about calculation view with time dimension where standard time-related tables like M_TIME_DIMENSION_YEAR, M_TIME_DIMENSION_MONTH, M_TIME_DIMENSION_WEEK, M_TIME_DIMENSION are required? I am using trial Hana XSA Web IDE on GCP and i dont see any SYS_BI schema. Can i actually create the time-related tables myself in Web IDE? If yes, how can i generate time-related data?

    • @LuciaSubatin
      @LuciaSubatin 6 років тому

      Hi, Chloe! If you are in SPS03, right click on the database module --> modelling actions --> Maintain time data. The wizard will generate tables and their data if they are not present. If you are looking for the same functionality for plain schemata (like the time generation from HANA Studio), you can right click on the connection to, for example, the tenant HXE and choose "Generate Time Data" from the database explorer

    • @MikeHowles
      @MikeHowles 5 років тому

      You can, however I do not know how to generate the data in the DEPLOYed version.