Kafka AND REST for communication between microservices?
Daniel Eisenreich
I am currently working on an architecture see below. First I'm not sure if this kind of architecture is called an event-driven or a data-driven architecture or maybe both.
There some input messages are sent from the Frontend to T1. These messages are first validated, then collected and in the end evaluated.
My current approach is to persist the raw messages with all meta information in MS A, the sorted collections in MS B and the evaluations in MS C. This separates the data to the appropriately concerned microservices.
In T2 I only produce the messages which MS B requires.
In T3 I only produce the messages which MS C requires.
But when evaluation the collections all meta information from MS A is required. So how to proceed with this kind?
- Should I send only the minimum of data to the queue and provide an API?
- Should I send all data to the queues (forward data for following services)?
- Should I send all information for the next service to the queue and provide an API?
- Something else?
Or did I misunderstand the approach "Communicating microservices through Kafka"?
Please feel free to offer criticism!
Thanks for advice!
Constantin Galbenu
I believe that this is a message-driven and a data-driven architecture, but this should not be important. What it is more important is that the microservices use Choreography (as opposed to Orchestration). This question could help.
The cleanest architecture would be to put all the data in the messages, in this way the number dependencies is limited to 2. Also, the resilience of the system is increased: if the microservice A is down, the other downstream microservices could continue to work.
Every microservice consume only the part of the message that interests it and ignores the other. This creates a nice and extendable pipeline of stream-like processing. If, however, the message is too big, you should use the Microservice A (or any other microservice) as the reference for more data.
Collected from the Internet
Please contact [email protected] to delete if infringement.
edited at
- Prev: Taking out just one value from an array
- Next: Is it possible to get output result set from SQL Server stored procedure before the trigger executes?
Related
TOP Ranking
- 1
pump.io port in URL
- 2
How to import an asset in swift using Bundle.main.path() in a react-native native module
- 3
Failed to listen on localhost:8000 (reason: Cannot assign requested address)
- 4
Inner Loop design for webscrapping
- 5
Can't pre-populate phone number and message body in SMS link on iPhones when SMS app is not running in the background
- 6
mysql.connector.errors.InterfaceError: 2003: Can't connect to MySQL server on '127.0.0.1:3306' (111 Connection refused)
- 7
Removed zsh, but forgot to change shell back to bash, and now Ubuntu crashes (wsl)
- 8
ggplotly no applicable method for 'plotly_build' applied to an object of class "NULL" if statements
- 9
How to run blender on webserver?
- 10
Resetting Value of <input type="time"> in Firefox
- 11
Converting a class method to a property with a backing field
- 12
Ambiguous use of 'init' with CFStringTransform and Swift 3
- 13
Execute ./script.sh with a crontab
- 14
How to set tab order for array of cluster,where cluster elements have different data types in LabVIEW?
- 15
How to pass data to the ng2-bs3-modal?
- 16
Retrieve Element Tag Value XML Using Bash
- 17
Spring Boot JPA PostgreSQL Web App - Internal Authentication Error
- 18
SQL Server : need add a dot before two last character
- 19
Making Array From Page Elements in jQuery
- 20
Laravel's ORM sync with timestamps doesn't update timestamps
- 21
Do animations stop css changes after animation completion?
Comments