{ Community }
  • Academy
  • Docs
  • Developers
  • Resources
    • Community Articles
    • Apigee on GitHub
    • Code Samples
    • Videos & eBooks
    • Accelerator Methodology
  • Support
  • Ask a Question
  • Spaces
    • Product Announcements
    • General
    • Edge/API Management
    • Developer Portal (Drupal-based)
    • Developer Portal (Integrated)
    • API Design
    • APIM on Istio
    • Extensions
    • Business of APIs
    • Academy/Certification
    • Adapter for Envoy
    • Analytics
    • Events
    • Hybrid
    • Integration (AWS, PCF, Etc.)
    • Microgateway
    • Monetization
    • Private Cloud Deployment
    • 日本語コミュニティ
    • Insights
    • IoT Apigee Link
    • BaaS/Usergrid
    • BaaS Transition/Migration
    • Apigee-127
    • New Customers
    • Topics
    • Questions
    • Articles
    • Ideas
    • Leaderboard
    • Badges
  • Log in
  • Sign up

Get answers, ideas, and support from the Apigee Community

  • Home /
  • Edge/API Management /
avatar image
1
Question by Reza Khan · Jul 08, 2016 at 12:42 AM · 786 Views analyticspostgresanalytic service apidatabase connectivity

Relocating Edge Analytic Database (PostgreSQL) to Amazon RDS

Hi Everyone

As you know, one of the main Edge components is Analytic POD (including PostgreSQL Database and Postgres Server), which at the moment lives on EC2 and required high IOPS to handle its tasks.

We are building our Edge on AWS (similar to 13 hosts topology) and trying to take advantage of Amazon Services including EC2 and RDS services. Our platform is multi-AZ / active-active (plan to go three AZ in the future), therefore we need to handle database replication cross AZ very well designed and implemented. At the moment Amazon PostgreSQL RDS service can handle replication, database backup and recovery etc.

[ Step 1 - Creating Database in AWS]

I have created an RDS database for apigee analytic the same way as the installer script doing for installing component "apigee-postgresql".

analytic-database.png

apigee-sql.txt

[ Step 2 - Modifying installer to install only "edge-postgres-serve"]

Edited the /opt/apigee-setup/bin/setup.sh and find the line related to "apigee-postgresql" and commented out.

/opt/apigee-setup/bin/setup.sh


if ((INST_APIGEE_PS)); then
	REGION_validate "$REGION" || exit 1

        # Commented our as I am using AWS RDS as a Database Service
	# setup_component "apigee-postgresql"

	setup_component "edge-postgres-serve”
fi

[ Step 3- Calling installer to install "edge-postgres-serve" component]

After editing the setup.sh file, I tried to configure the "" using the following profile:

/opt/apigee-setup/bin/setup.sh -p ps -f /tmp/dc01-infrustructure.cfg

There are two key points here

  • As I modified the setup.sh the installer will not try to install the database on the local EC2 machine.
  • The installer failed to populate the database tables (22 tables required to store the analytic information) as it expect to see the database on the localhost.

My observation was , the setup will wait for a couple of mins and then displays the success message.

However, when the service starts to run and bring the postgres server, the following error message will appear in the log.

postgres.jpg

My questions is how can I tell my installer what is my database IP address. I know that the postgres server will communicate with zookeeper to obtain the analytic server information.

Is there anyway magic way to tell the installer, or after installation to configure the server to look for database server IP in a config file ?

I appreciate if you have a look into my issue, and I believe broad range of consumers looking for using AWS services as much as possible.

postgres.jpg (282.4 kB)
analytic-database.png (61.4 kB)
apigee-sql.txt (1.0 kB)
Comment
Add comment
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Close

2 Answers

  • Sort: 
avatar image
1

Answer by Baba Krishnankutty · Jul 22, 2016 at 01:28 AM

This is not a supported option at the moment. Current architecture have an aggregator running on the postgres server node itself. Moving aggregator out of the PG server is an architecture change.

Comment
Add comment Show 1 · Link
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image Nagendra Buddhala · Jan 13, 2018 at 01:00 AM 0
Link

@Baba Krishnankutty Hi, can you please confirm if the above statement is still valid with the apigee edge 4.17.09.

avatar image
0

Answer by Baba Krishnankutty · Jan 13, 2018 at 03:54 AM

Underlying architecture haven't changed in 4.17.09

Comment
Add comment Show 3 · Link
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image Nagendra Buddhala · Jan 13, 2018 at 04:26 AM 0
Link

Thanks a lot @Baba Krishnankutty that helps!

avatar image Kashmira Patel · Apr 12, 2019 at 07:25 PM 0
Link

Checking to see if this supported in 4.19.01?

Thank you!

avatar image Dino-at-Google ♦♦ Kashmira Patel   · Apr 12, 2019 at 08:46 PM 0
Link

Nope. No change. Same restriction.

But check the beta Hybrid announcement. You may be able to use cloud-based Analytics (not AWS RDS) with an on-premises gateway.

Follow this Question

Answers Answers and Comments

45 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Issue with analytics 0 Answers

Edge analytics and management APIs showing different statistics. 0 Answers

Trying to generate log files using Apigee built in Rest API 1 Answer

Error: Missing select parameter : while fetching analytics data from management server on 13 node cluster 2 Answers

Restrict viewing proxy analytics 1 Answer

  • Products
    • Edge - APIs
    • Insights - Big Data
    • Plans
  • Developers
    • Overview
    • Documentation
  • Resources
    • Overview
    • Blog
    • Apigee Institute
    • Academy
    • Documentation
  • Company
    • Overview
    • Press
    • Customers
    • Partners
    • Team
    • Events
    • Careers
    • Contact Us
  • Support
    • Support Overview
    • Documentation
    • Status
    • Edge Support Portal
    • Privacy Policy
    • Terms & Conditions
© 2021 Apigee Corp. All rights reserved. - Apigee Community Terms of Use - Powered by AnswerHub
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Create an article
  • Post an idea
  • Spaces
  • Product Announcements
  • General
  • Edge/API Management
  • Developer Portal (Drupal-based)
  • Developer Portal (Integrated)
  • API Design
  • APIM on Istio
  • Extensions
  • Business of APIs
  • Academy/Certification
  • Adapter for Envoy
  • Analytics
  • Events
  • Hybrid
  • Integration (AWS, PCF, Etc.)
  • Microgateway
  • Monetization
  • Private Cloud Deployment
  • 日本語コミュニティ
  • Insights
  • IoT Apigee Link
  • BaaS/Usergrid
  • BaaS Transition/Migration
  • Apigee-127
  • New Customers
  • Explore
  • Topics
  • Questions
  • Articles
  • Ideas
  • Badges