[ad_1]
Amazon Redshift is a completely managed, petabyte-scale knowledge warehouse service within the cloud. You can begin with only a few hundred gigabytes of information and scale to a petabyte or extra. This allows you to use your knowledge to accumulate new insights for your online business and clients. In the present day, tens of 1000’s of AWS clients—from Fortune 500 firms, startups, and every part in between—use Amazon Redshift to run mission-critical enterprise intelligence (BI) dashboards, analyze real-time streaming knowledge, and run predictive analytics jobs. With the fixed improve in generated knowledge, Amazon Redshift clients proceed to realize successes in delivering higher service to their end-users, bettering their merchandise, and operating an environment friendly and efficient enterprise.
A number of new options of Amazon Redshift deal with a variety of analytics necessities and enhance efficiency of the cloud knowledge warehouse:
To reap the benefits of these capabilities and future improvements, you could migrate out of your current knowledge warehouse to Amazon Redshift.
On this submit, we present you migrate your knowledge warehouse schema from Snowflake to Amazon Redshift utilizing AWS Schema Conversion Device (AWS SCT). AWS SCT is a service that makes heterogeneous database migrations predictable by robotically changing the supply database schema and a majority of the database code objects, together with views, saved procedures, and capabilities, to a format appropriate with the goal database. Any objects that may’t be robotically transformed are clearly marked in order that they are often manually transformed to finish the migration. AWS SCT may also scan your software supply code for embedded SQL statements and convert them as a part of a database schema conversion challenge. Throughout this course of, AWS SCT performs cloud-native code optimization by changing legacy knowledge warehouse capabilities to their equal AWS service, thereby serving to you modernize the functions on the similar time of database migration.
Answer overview
To implement this answer, you full the next high-level steps:
- Configure your AWS SCT software.
- Analyze your supply Snowflake schema.
- Convert your Snowflake schema to an Amazon Redshift schema.
- Deploy the schema to Amazon Redshift.
The next diagram illustrates the answer structure.
Conditions
Earlier than beginning this walkthrough, you could have the next stipulations:
Arrange an AWS SCT challenge and extract the schema from the supply
On this walkthrough, we use the Snowflake pattern database TPCDS_SF10TCL because the supply of the schema conversion.
To arrange the database migration challenge, full the next steps:
- Launch the AWS SCT software.
- On the File menu, select New challenge wizard.
- Enter the challenge identify and placement.
- For Supply engine, select Snowflake.
- Select Subsequent.
- Present the database info and credentials for Snowflake and select Check Connection.
- When the connection is profitable, select Subsequent.
For extra info, see Utilizing Snowflake as a supply for AWS SCT.
- Increase SNOWFLAKE_SAMPLE_DATA and Schemas.
- Choose TPCDS_SF10TCL and select Subsequent.
AWS SCT analyzes the schema and prepares an evaluation report abstract, as proven within the following screenshot.
This report summarizes the objects that AWS SCT converts to Amazon Redshift.
- Evaluation the report and select Subsequent.
- Present the database info and credentials for Amazon Redshift and deselect Use AWS Glue.
- Select Check Connection.
- When the connection is profitable, select End.
For extra details about establishing a connection to Amazon Redshift, see Getting the JDBC URL.
Evaluation and apply the schema from Snowflake to Amazon Redshift
To transform the schema from Snowflake objects to Amazon Redshift, full the next steps:
- Increase SNOWFLAKE_SAMPLE_DATA and Schemas.
- Select (right-click) TPCDS_SF10TCL and select Convert schema.
- Select Accumulate and proceed.
AWS SCT converts the schema and exhibits the transformed schema and objects in the precise pane. The transformed schema is marked with a purple examine mark.
Amazon Redshift take some actions robotically whereas changing the schema to Amazon Redshift; objects with such actions are marked with a purple warning signal.
- Select the thing after which on the highest menu, select Primary view and select Evaluation Report view.
- Select the Motion gadgets tab.
You may see listing of all points and actions taken by AWS SCT.
You may consider and examine the person object DDL by deciding on it from the precise pane, and you may as well edit it as wanted. Within the following instance, we modify the DISTKEY to make use of inv_item_sk. AWS SCT analyze the tables and recommends the distribution and type keys primarily based on the statistics. For instances the place you’re unsure, you must set it to AUTO. For extra details about automated knowledge distribution and optimization in Amazon Redshift, check with Automate your Amazon Redshift efficiency tuning with automated desk optimization.
- To deploy the objects DDL to Amazon Redshift, choose the transformed schema in the precise pane, right-click, and select Apply to database.
- Optionally, if you wish to export the copy of the DDLs generated by AWS SCT and apply them manually, you possibly can choose the Amazon Redshift transformed schema, right-click, and select Save as SQL.
- Log in to your Amazon Redshift cluster utilizing the Question Editor V2.
For extra details about Question Editor V2, check with Introducing Amazon Redshift Question Editor V2, a Free Net-based Question Authoring Device for Knowledge Analysts.
- To confirm that the transformed schema objects are deployed in Amazon Redshift, choose the specified desk, right-click, and select Present desk definition to see the underlying DDL.
Clear up
To keep away from incurring future fees, full the next steps:
- Delete the Amazon Redshift cluster created for this demonstration.
- In case you have been utilizing an current cluster, delete the brand new tables that you simply created as a part of this train.
- Cease any Amazon Elastic Compute Cloud (Amazon EC2) cases that have been created to run the AWS SCT software.
Abstract
On this submit, we confirmed how simple it’s to transform a Snowflake schema to an Amazon Redshift schema and used AWS SCT for this automated conversion.
We look ahead to listening to from you about your expertise. In case you have questions or ideas, please depart a remark.
In regards to the Authors
BP Yau is a Sr Analytics Specialist Options Architect at AWS. His position is to assist clients architect massive knowledge options to course of knowledge at scale. Earlier than AWS, he helped Amazon.com Provide Chain Optimization Applied sciences migrate its Oracle knowledge warehouse to Amazon Redshift and construct its subsequent era massive knowledge analytics platform utilizing AWS applied sciences.
Tahir Aziz is an Analytics Answer Architect at AWS. He has labored with constructing knowledge warehouses and large knowledge options for over 13 years. He loves to assist clients design end-to-end analytics options on AWS. Outdoors of labor, he enjoys touring and cooking.
Shawn Sachdev is a Sr Analytics Specialist Options Architect at AWS. He works with clients and gives steerage to assist them innovate and construct well-architected and high-performance knowledge warehouses and implement analytics at scale on the AWS platform. Earlier than AWS, he has labored in a number of Analytics and System Engineering roles. Outdoors of labor, he loves watching sports activities, and is an avid foodie and a craft beer fanatic.
Srikanth Sopirala is a Principal Analytics Specialist Options Architect at AWS. He’s a seasoned chief with over 20 years of expertise, who’s obsessed with serving to clients construct scalable knowledge and analytics options to realize well timed insights and make essential enterprise choices. In his spare time, he enjoys studying, spending time along with his household, and street biking.
[ad_2]
