Automated jobs/tasks to migrate Data from variety of sources (From Cloud to local) (Using Airflow and handwritten scheduler) ETL jobs for analytics dashboard and db.

Project involved 500+ tables, 5 warehouses and Lake Designing DB’s to store department specific data. Designing ‘crawlers’ to identify freshly inserted data and their location Developing tasks/jobs for ingestion. Creating ETL’s and streams to shift warehouse data into marts.

Platform for automated Data Scraping/Mining process. Users can upload and manage “Scraping Tasks”. Users can set their own configurations and data receiving plans. Example User Experience: “Scrape amazon.com for this tag (id, class, xPath…) and send received data on me@gmail.com”.

Real time analytics dashboard, which orchestrates Data gathering, transformation and analysis process. Platforms allows users to easily integrate with variety of databases, upload their own ETL pipelines and generate Charts, Diagrams and graphs for the data

Administrator dashboard allowing HR managers to track/adjust working hours of employees (Data Gathered from badges and Active Directory). User dashboard allowing employees to approve, review or request a change of their work-hours. Notifications and reminders for employees (sent via sms and Email)

Real time dashboard, listing all currently flowing transactions. Alerts/Notifications on possible fraud or unexpected transactions. System users can export, filter and permanently highlight transactions. System users can add/modify custom alerts on specific transactions or swaps.

Bot is trading on SPOT, not MARGIN) Platform allowing users to: Track all balances in one centralized place Modify current bot configuration (percentages, margins, indicators and etc.) Start/Stop/Pause bot. Real time dashboard tracking current bot states, configurations and detailed information, such as: incomes, margins, average pricing, depth analysis and different indicators

API based document and file approval system, which allows users and groups to fetch all existing documents/files from the storage (blob, local and domain) and list them. Users can see document/file metadata (such as “modified by”, “creation date”) and also modification history (version control). Authorized users can approve/reject or send files to review. API also provides logs for each storage, document or group.