Hello,
We have APIGEE Edge for Private Cloud 12 node multi data center setup (Active/Active in 2 DCs) with 6 cassandra nodes cluster (3 each DC). Configuration for cassandra is as follow - Replication Factor 3 in each DC, Consistency Level is LOCAL_QUORAM with NetworkTopology strategy.
When Authorization token is issued to clients in DC1 and within milliseconds, if request lands on DC2 then while verifying the token, proxy is returning an error. (as token may not have got replicated)
As per our understanding with NetworkToplology strategy, token will asynchronously gets replicated on one node in DC2 and eventually get replicated to all nodes in DC2.
If there is some latency in replication and request lands on DC2 proxy, before replication is completed then cassandra coordinator won't find data on DC2. In such cases DC2 coordinator shall forward read to DC1 to fetch token data from DC1 and then DC2 proxy should verify the token successfully.
However in our case consumer are receiving error since proxy is not able to verify such tokens. What is the configuration required apart from workaround of adding delay at the time of sending response while generating tokens.
LinkedIn
Twitter
