Skip to content

pranjalmohansaxena/TKPModellingTechWorkshop

Repository files navigation

TKPModellingTechWorkshop

This service is for Real-Time Streaming Pipeline Engine for Storing Hundreds Million of Data It follows Clean Architecture. It has below layers:

Delivery Layer: It deals with consuming events from Kafka
Schema:

type Delivery interface {
	ConsumeEvents(topicName string)
}

Usecase Layer: It deals with processing the Kafka Events and invoking Datastore Repository
Schema:

type Usecase interface {
	ProcessData(events []interface{})
}

Repository Layer: It deals with storing the processed data to Cassandra


Schema:

type Repository interface {
	Store(data []map[string]interface{}) (err error)
}

Sample Events from Kafka would be of below format

{
    "pid": 123,
    "recommended_pids": [456,789]
}

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages