{ Community }
  • Academy
  • Docs
  • Developers
  • Resources
    • Community Articles
    • Apigee on GitHub
    • Code Samples
    • Videos & eBooks
    • Accelerator Methodology
  • Support
  • Ask a Question
  • Spaces
    • General
    • Business of APIs
    • API Design
    • Academy/Certification
    • Analytics
    • Apigee Test - beta
    • Apigee-127
    • BaaS/Usergrid
    • Developer Portal
    • Edge/API Management
    • Events
    • Insights
    • Integration (AWS, PCF, Etc.)
    • IoT - Apigee Link
    • Microgateway
    • Monetization
    • Private Cloud Deployment
    • New Customers
    • Topics
    • Questions
    • Articles
    • Ideas
    • Leaderboard
    • Badges
  • Log in
  • Sign up

Get answers, ideas, and support from the Apigee Community

  • Home /
  • Edge/API Management /
avatar image
1
Question by Reza Motevallizadeh · Jul 08, 2016 at 12:42 AM · 332 Views analyticspostgresanalytic service apidatabase connectivity

Relocating Edge Analytic Database (PostgreSQL) to Amazon RDS

Hi Everyone

As you know, one of the main Edge components is Analytic POD (including PostgreSQL Database and Postgres Server), which at the moment lives on EC2 and required high IOPS to handle its tasks.

We are building our Edge on AWS (similar to 13 hosts topology) and trying to take advantage of Amazon Services including EC2 and RDS services. Our platform is multi-AZ / active-active (plan to go three AZ in the future), therefore we need to handle database replication cross AZ very well designed and implemented. At the moment Amazon PostgreSQL RDS service can handle replication, database backup and recovery etc.

[ Step 1 - Creating Database in AWS]

I have created an RDS database for apigee analytic the same way as the installer script doing for installing component "apigee-postgresql".

analytic-database.png

apigee-sql.txt

[ Step 2 - Modifying installer to install only "edge-postgres-serve"]

Edited the /opt/apigee-setup/bin/setup.sh and find the line related to "apigee-postgresql" and commented out.

/opt/apigee-setup/bin/setup.sh


if ((INST_APIGEE_PS)); then
	REGION_validate "$REGION" || exit 1

        # Commented our as I am using AWS RDS as a Database Service
	# setup_component "apigee-postgresql"

	setup_component "edge-postgres-serve”
fi

[ Step 3- Calling installer to install "edge-postgres-serve" component]

After editing the setup.sh file, I tried to configure the "" using the following profile:

/opt/apigee-setup/bin/setup.sh -p ps -f /tmp/dc01-infrustructure.cfg

There are two key points here

  • As I modified the setup.sh the installer will not try to install the database on the local EC2 machine.
  • The installer failed to populate the database tables (22 tables required to store the analytic information) as it expect to see the database on the localhost.

My observation was , the setup will wait for a couple of mins and then displays the success message.

However, when the service starts to run and bring the postgres server, the following error message will appear in the log.

postgres.jpg

My questions is how can I tell my installer what is my database IP address. I know that the postgres server will communicate with zookeeper to obtain the analytic server information.

Is there anyway magic way to tell the installer, or after installation to configure the server to look for database server IP in a config file ?

I appreciate if you have a look into my issue, and I believe broad range of consumers looking for using AWS services as much as possible.

postgres.jpg (282.4 kB)
analytic-database.png (61.4 kB)
apigee-sql.txt (1.0 kB)
Comment
Add comment
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Close

2 Answers

· Add your answer
  • Sort: 
avatar image
0

Answer by Baba Krishnankutty · Jul 22, 2016 at 01:28 AM

This is not a supported option at the moment. Current architecture have an aggregator running on the postgres server node itself. Moving aggregator out of the PG server is an architecture change.

Comment
Add comment Show 1 · Link
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image Nagendra Buddhala · Jan 13 at 01:00 AM 0
Link

@Baba Krishnankutty Hi, can you please confirm if the above statement is still valid with the apigee edge 4.17.09.

avatar image
0

Answer by Baba Krishnankutty · Jan 13 at 03:54 AM

Underlying architecture haven't changed in 4.17.09

Comment
Add comment Show 1 · Link
10 |5000 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by Apigeeks only
  • Viewable by the original poster
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users
avatar image Nagendra Buddhala · Jan 13 at 04:26 AM 0
Link

Thanks a lot @Baba Krishnankutty that helps!

Your answer

Hint: You can notify a user about this post by typing @username

Up to 5 attachments (including images) can be used with a maximum of 5.0 MB each and 25.0 MB total.

Follow this Question

Answers Answers and Comments

43 People are following this question.

avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image avatar image

Related Questions

Issue with analytics 0 Answers

analytics api 1 Answer

External Authorization - Analytics Feature - Apigee Edge 1 Answer

Developer Registrations Over Time Report 3 Answers

How to determine what protocol is being used by the clients while connecting to Edge ? 3 Answers

  • Products
    • Edge - APIs
    • Insights - Big Data
    • Plans
  • Developers
    • Overview
    • Documentation
  • Resources
    • Overview
    • Blog
    • Apigee Institute
    • Academy
    • Documentation
  • Company
    • Overview
    • Press
    • Customers
    • Partners
    • Team
    • Events
    • Careers
    • Contact Us
  • Support
    • Support Overview
    • Documentation
    • Status
    • Edge Support Portal
    • Privacy Policy
    • Terms & Conditions
© 2018 Apigee Corp. All rights reserved. - Apigee Community Terms of Use - Powered by AnswerHub
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Create an article
  • Post an idea
  • Spaces
  • General
  • Business of APIs
  • API Design
  • Academy/Certification
  • Analytics
  • Apigee Test - beta
  • Apigee-127
  • BaaS/Usergrid
  • Developer Portal
  • Edge/API Management
  • Events
  • Insights
  • Integration (AWS, PCF, Etc.)
  • IoT - Apigee Link
  • Microgateway
  • Monetization
  • Private Cloud Deployment
  • New Customers
  • Explore
  • Topics
  • Questions
  • Articles
  • Ideas
  • Members
  • Badges