Skip to content

Commit

Permalink
updated assests
Browse files Browse the repository at this point in the history
  • Loading branch information
TheDataAreClean committed Oct 25, 2021
1 parent f58208b commit 4f0d15a
Show file tree
Hide file tree
Showing 8 changed files with 18 additions and 18 deletions.
2 changes: 1 addition & 1 deletion data-stories/001-requirements.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ It is important to determine if an insight merits its own data story. An insight

Use the below matrix to evaluate an insight.

![Insight evaluation matrix](../_assets/matrix.png)
![Insight evaluation matrix](./assets/matrix.png)
> Credits: *BRENT DYKES | Effective Data Storytelling: How To Drive Change With Data, Narrative, and Visuals (WILEY 2020)*
#### 2. Data
Expand Down
File renamed without changes
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added system-architecture/assets/data-source.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed system-architecture/assets/data_source.jpg
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added system-architecture/assets/user-facing.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
34 changes: 17 additions & 17 deletions system-architecture/readme.md
Original file line number Diff line number Diff line change
@@ -1,46 +1,46 @@
# System Architecture

Following are the major components of the System
Following are the major components of the System:

1. User facing portals
2. Data Sourcing
3. Data storage
1. Data Sourcing
2. Data Storage
3. User Facing Portals
4. Monitoring and Analysis

![1](./assets/big_picture.jpg)
![1](./assets/platform-architecture.png)

## User Facing Portals
![1](./assets/portals.jpg)

![1](./assets/user-facing.png)

This is the group of all systems which caters to userflows which are enduser facing. Following are some key identified systems:

- Data Catalog
- Stories and Blogs
- Community forum
- Information portal
- Data management platform
- Sytem moderation control panal

- Community Forum
- Information Portal
- Data Management Platform
- System Moderation Control Panel

## Data Sourcing
![1](./assets/data_source.jpg)
![1](./assets/data-source.png)

The system would support sourcing of data from three different processes
1. Direct bulk upload by system maintainer
2. Data collected from primary data collection
3. Data periodically updated via automated processes

## Data Storage
The system contains various datastorage capabilities at different levels of the platform. Each component in the system would have a temporary storage to enable faster data access and processing.
The system contains various data storage capabilities at different levels of the platform. Each component in the system would have a temporary storage to enable faster data access and processing.

All datasets are stored pre and post procesing to enable higher reselience against dataloss. The central datastore manages the processing, idexing, caching and archival of data.
All datasets are stored pre and post processing to enable higher resilience against data loss. The central datastore manages the processing, indexing, caching and archival of data.

A knowledgegraph of all the base truths in the system is maintained to enable information mapping against mutiple datasources.
A knowledge graph of all the base truths in the system is maintained to enable information mapping against mutiple data sources.

![1](./assets/storage.jpg)


## Monitoring and Analysis
The system would be equipted with central monitoring system to monitor workflows between all the components of the system. This system would also allow mannual interventions and policy enforcements.
The system would be equipped with central monitoring system to monitor workflows between all the components of the system. This system would also allow manual interventions and policy enforcement.

The processesed data is also avalilable to allow analysis of all the datasets present in the system.
The processesed data is also available to allow analysis of all the datasets present in the system.

0 comments on commit 4f0d15a

Please sign in to comment.