APIGee for Load testing APIs?

Not applicable

Team,

I need some assistance as I'm evaluating Apigee. My team has built custom APIs on the Salesforce platform and need to do some load testing. We've been looking for a tool to handle this easily but there are few options that I can find.

I'm not a developer but I'm doing my best. Can you let me know how you might do a load test on a Salesforce API? We've looked at a few tools (Provar, Loader.IO, Blitz.IO, JMeter) but haven't had much luck. We'd use JMeter but it seems to need us to set up the servers/users ourselves and that is not possible.

Please advise if Apigee could help us!

0 4 1,994
4 REPLIES 4

adas
Participant V

@Jay Kilian There are various open source options available. Here are few options that we use in-house. I am listing down the pros and cons of all those so that you can make an informed decision:

ToolProsCons
1. JMeterOpen source, comes with a intuitive UI. Built in assertion module. Reporting based on latency and throughput is usefulJMeter doesn't scale when you need to generate huge load. JMeter saturates itself and the max you can generate is 200 concurrent threads on a standard VM running JMeter
2. Apache BenchOpen source, easy to use. Can be used for simple benchmarking tasks by making cURL like callsDoesn't work if for complex APIs, where you may need orchestration of multiple API calls to form a scenario. Reporting is not very flexible
3. ApibThis is written by Apigee's Greg Brail. Its lightweight and similar to Apache Bench. Able to generate more load per client than both JMeter and Apache BenchReports are not as useful. You cannot make complex scenarios that require dynamic inputs or api orchestrations
4. GatlingThis has emerged as the new standard for API testing. Code is written in scala. Gives you better control over the code and you can write and maintain the scenarios and add extra flexibility. Reporting is good. Integrates with build tools like mvn and sbt.Writing scala code may not be easy to start with. Once you get past the intial hurdle, its all fine.

Here's a very interesting comparison between Jmeter and Gatling:

https://blog.flood.io/stress-testing-jmeter-and-gatling/

So I would suggest gatling for your API performance testing. Other useful links:

http://stackoverflow.com/questions/10260526/which-gets-the-measurements-right-jmeter-or-apache-ab

https://octoperf.com/blog/2015/06/08/jmeter-vs-gatling/

https://blazemeter.com/blog/open-source-load-testing-tools-which-one-should-you-use

Arghya,

Have you tried JMETER with Apigee? We are testing it and need to Gen the HMAC Auth. but dont have a JAVA Script to do it or really understand how to set it up in JMETER

Not applicable

Thank you! I will assess all of these in the morning. Do you have any knowledge on Blazemeter? It looks like it works with JMeter but overcomes some of the scaling issues?

https://www.blazemeter.com/usecases#features-performance

Yes, Blazemeter is an impressive tool. I know they have done some integrations with Jmeter as well as something with gatling. Its essentially Jmeter on the cloud that takes care of scaling by letting you do some distributed load generation. However I believe its the paid version that has all this cool features. I used the demo version for a while during my evaluation and it had decent feature set.