hbase blog

content/blog/2023/2023-05-25-how-to-modernize-a-legacy-hbase-solr-architecture-into-amazon-using-kinesis-lambda-and-opensearch/index.md

@@ -0,0 +1,129 @@
+---
+layout: post
+title: "How to Modernize a Legacy Hbase/Solr Architecture into Amazon using Kinesis, Lambda, and Opensearch"
+date: 2023-05-25
+comments: true
+author: Daniel Quach and Anil Kumar
+authorAvatar: 'https://secure.gravatar.com/avatar/'
+bio: "Daniel Quach is a Rackspace Professional Services Data Practice Manager and Anil Kumar is a Rackspace Professional Services Big Data Engineer"
+published: true
+authorIsRacker: true
+categories:
+    - Data
+    - DevOps
+metaTitle: ""How to Modernize a Legacy Hbase/Solr Architecture into Amazon using Kinesis, Lambda, and Opensearch"
+metaDescription: "As technology advances and business requirements change, organizations may find themselves needing to migrate away from legacy data processing systems like HBase, Solr, and HBase Indexer."
+ogTitle: "How to Modernize a Legacy Hbase/Solr Architecture into Amazon using Kinesis, Lambda, and Opensearch"
+ogDescription: "As technology advances and business requirements change, organizations may find themselves needing to migrate away from legacy data processing systems like HBase, Solr, and HBase Indexer."
+slug: "how-to-modernize-a-legacy-hbase-solr-architecture-into-amazon-using-kinesis-lambda-and-opensearch "
+---
+
+As technology advances and business requirements change, organizations may find themselves needing to migrate away from legacy data processing systems like HBase, Solr, and HBase Indexer. While these systems may have served their purpose in the past, they may no longer be sufficient for the needs of modern data platforms because of the challenges of scalability and maintenance.  
+<!--more-->
+
+#### Overview
+
+. Read replica is useful when we have reporting applications that are only using the select command on the database. Read replicas cannot be used for the update or delete operation and these are just used for reporting purposes. However, before getting into the configuration steps, let’s understand RDS a little better. 
+
+**Amazon RDS: What is RDS?**
+
+-	As mentioned above, RDS is an acronym for relational database service.
+-	It uses SQL
+-	Supported Engines: PostgresSQL, MySQL, MariaDB, Oracle, Microsoft SQL Server, Aurora
+-	Launched within a VPC and usually in a private subnet.
+-	Storage by EBS
+-	Backup: Automated with point-in-time recovery.
+-	Can monitor through cloud watch and Configure RDS events. 
+-	Can take snapshots across regions.
+
+**Now, let’s proceed with the RDS configuration.**
+
+Assuming we already have an amazon account. The next step is to create an RDS instance from the RDS console.
+
+<img src=Picture1.png title="" alt="">
+
+Once we click on create database button, a user gets redirected to the next screen as shown in the following snapshot. 
+<img src=Picture2.png title="" alt="">
+
+We will go with the Standard create and thereafter select the engine type. For this scenario, I have chosen MYSQL engine and version 5.7.40 Also depending on the requirements you can choose template type. In this example, I have opted for the Free tier option as we are illustrating it for learning purpose only.
+<img src=Picture3.png title="" alt="">
+
+<img src=Picture4.png title="" alt="">
+
+<img src=Picture5.png title="" alt="">
+
+Once the above steps are completed, you need to provide database and admin credentials.
+
+<img src=Picture6.png title="" alt="">
+
+Now fill in the instance configuration, storage, and connectivity information.
+
+<img src=Picture7.png title="" alt="">
+<img src=Picture8.png title="" alt="">
+<img src=Picture9.png title="" alt="">
+<img src=Picture10.png title="" alt="">
+<img src=Picture11.png title="" alt="">
+
+
+You need to fill in the VPC, subnet group, and security group or you can choose the default values as well. In the authentication field, password authentication is used. Also, as we are using the free tier not all options are available for use.
+
+Now click on create database and it will take a while to complete the configuration. One can keep refreshing the page to see the progress 
+<img src=Picture12.png title="" alt="">
+Once the database is successfully created, select only that database for which a read replica needs to be created. It can be created from the action drop-down menu and by selecting “Create read Replica”.
+
+<img src=Picture13.png title="" alt="">
+
+Now you will see the following screen pop-up to fill out the required information. In my example, I am choosing the default values to keep things simple. The DB identifier field cannot be left blank.
+
+<img src=Picture14.png title="" alt="">
+
+After clicking on the read replica button, you will see the following screen. you can track the progress of the read replica of our RDS instance. Once it is complete, move to the next step and promote the read replica to a standalone database.
+
+<img src=Picture15.png title="" alt="">
+
+This creates the read replica and can be promoted as a standalone DB as you can see in the following snippet. It will take you to the next screen and just click on the button to create a standalone DB.
+
+<img src=Picture16.png title="" alt="">
+
+As your read replica is promoted to a standalone DB it is now available for all the operations like Select/insert/update as it is a complete database. Also you will notice that  database-1 link and dbreplica are no longer available (as you can see in the previous image), dbreplica is now a separate entity. 
+
+<img src=Picture17.png title="" alt="">
+
+#### Conclusion
+
+ I hope you will find the above steps useful in creating read replica and promote it to read write standalone instance. In the next part, I will discuss backup/recovery and failover on RDS.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+<a class="cta purple" id="cta" href="https://www.rackspace.com/data/managed-sql">Learn about Rackspace Managed SQL Databases.</a>
+
+<a class="cta purple" id="cta" href="https://www.rackspace.com/data/databases"> Learn about Rackspace Database Services.</a>
+
+Use the Feedback tab to make any comments or ask questions. You can also
+[start a conversation with us](https://www.rackspace.com/contact).