-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
TheDataAreClean
committed
Oct 25, 2021
1 parent
f58208b
commit 4f0d15a
Showing
8 changed files
with
18 additions
and
18 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,46 +1,46 @@ | ||
# System Architecture | ||
|
||
Following are the major components of the System | ||
Following are the major components of the System: | ||
|
||
1. User facing portals | ||
2. Data Sourcing | ||
3. Data storage | ||
1. Data Sourcing | ||
2. Data Storage | ||
3. User Facing Portals | ||
4. Monitoring and Analysis | ||
|
||
 | ||
 | ||
|
||
## User Facing Portals | ||
 | ||
|
||
 | ||
|
||
This is the group of all systems which caters to userflows which are enduser facing. Following are some key identified systems: | ||
|
||
- Data Catalog | ||
- Stories and Blogs | ||
- Community forum | ||
- Information portal | ||
- Data management platform | ||
- Sytem moderation control panal | ||
|
||
- Community Forum | ||
- Information Portal | ||
- Data Management Platform | ||
- System Moderation Control Panel | ||
|
||
## Data Sourcing | ||
 | ||
 | ||
|
||
The system would support sourcing of data from three different processes | ||
1. Direct bulk upload by system maintainer | ||
2. Data collected from primary data collection | ||
3. Data periodically updated via automated processes | ||
|
||
## Data Storage | ||
The system contains various datastorage capabilities at different levels of the platform. Each component in the system would have a temporary storage to enable faster data access and processing. | ||
The system contains various data storage capabilities at different levels of the platform. Each component in the system would have a temporary storage to enable faster data access and processing. | ||
|
||
All datasets are stored pre and post procesing to enable higher reselience against dataloss. The central datastore manages the processing, idexing, caching and archival of data. | ||
All datasets are stored pre and post processing to enable higher resilience against data loss. The central datastore manages the processing, indexing, caching and archival of data. | ||
|
||
A knowledgegraph of all the base truths in the system is maintained to enable information mapping against mutiple datasources. | ||
A knowledge graph of all the base truths in the system is maintained to enable information mapping against mutiple data sources. | ||
|
||
 | ||
|
||
|
||
## Monitoring and Analysis | ||
The system would be equipted with central monitoring system to monitor workflows between all the components of the system. This system would also allow mannual interventions and policy enforcements. | ||
The system would be equipped with central monitoring system to monitor workflows between all the components of the system. This system would also allow manual interventions and policy enforcement. | ||
|
||
The processesed data is also avalilable to allow analysis of all the datasets present in the system. | ||
The processesed data is also available to allow analysis of all the datasets present in the system. |