Ecomate-ML

Welcome to the Ecomate-ML! Follow these steps to set up your development environment and get started with contributing to the project.

Prerequisites

Before you begin, make sure you have the following installed on your machine:

• Docker
• Python (version 3.10.1 or higher)

Clone the Repository

git clone https://github.com/Ecomate-Green/Ecomate-ML.git
cd Ecomate-ML

Auto setup

Run the script for the fastest setup

./setup_dev_env.sh

Manual setup

# Create directory structure for project input data
mkdir -p input input/datasets

# Display pip version
pip --version

# Upgrade pip to the latest version
pip install --user -U pip

# Install or upgrade virtualenv package
# pip install --user -U virtualenv

pip uninstall virtualenv
pip install virtualenv

# Create a virtual environment named my_env
virtualenv my_env

# Activate the virtual environment
source my_env/Scripts/activate

# Install project in editable mode
pip install -e .

# Install required Python packages listed in requirements.txt
pip install -r requirements.txt

Now every time you want to activate this environment, just open a terminal and type the following:

$ source my_env/bin/activate # on Linux or macOS
$ .\my_env\Scripts\activate # on Windows
# If you are using git as the main cmd:
$ source my_env/Scripts/activate

To deactivate this environment, type deactivate

$ deactivate

Setup and troubleshooting

while you are installing the TensorFlow I mean pip install tensorflow

if you got the following error:

>tensorflow-intel==2.15.0->tensorflow) (3.2.2)
Using cached tensorflow-2.15.0-cp310-cp310-win_amd64.whl (2.1 kB)
Using cached tensorflow_intel-2.15.0-cp310-cp310-win_amd64.whl (300.9 MB)
Installing collected packages: tensorflow-intel, tensorflow
ERROR: Could not install packages due to an OSError: [Errno 2] No such file or directory: 'C:\\Users\\mohee\\Desktop\\self_learning\\Kafka\\anomaly-detection-kafka-flink-es-ML\\AnomalyDetection\\src\\main\\py\\my_env\\Lib\\site-packages\\tensorflow\\include\\external\\com_github_grpc_grpc\\src\\core\\ext\\filters\\client_channel\\lb_policy\\grpclb\\client_load_reporting_filter.h'
HINT: This error might have occurred since this system does not have Windows Long Path support enabled. You can find information on how to enable this at https://pip.pypa.io/warnings/enable-long-paths

you could solve it by the following steps:

1. open the PowerShell by run as Administrator

2. write the following command

   # https://learn.microsoft.com/en-us/windows/win32/fileio/maximum-file-path-limitation?tabs=powershell#enable-long-paths-in-windows-10-version-1607-and-later
   New-ItemProperty -Path "HKLM:\SYSTEM\CurrentControlSet\Control\FileSystem" ` -Name "LongPathsEnabled" -Value 1 -PropertyType DWORD -Force