Agent execution layer for biology workflows: batch gene scanning, tumor cohort briefing, target discovery — with structured outputs, resume, and pipeline-ready artifacts
-
Updated
Apr 14, 2026 - TypeScript
Agent execution layer for biology workflows: batch gene scanning, tumor cohort briefing, target discovery — with structured outputs, resume, and pipeline-ready artifacts
ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau
An end-to-end machine learning project predicting DoorDash delivery durations, utilizing MLOps principles and best practices.
Docs-only case study of a compliance & anomaly detection platform on Azure + Databricks (Streaming ETL + Batch ELT + ML).
Reproducible e-commerce data pipeline focused on data engineering fundamentals
Docs-only case study – Compliance Reporting data platform on Azure for a Big-4 Audit & Consulting Firm (BFSI, healthcare-style datasets) using Streaming Pipeline (ETL) + Batch Pipeline (ELT) with Snowflake, Synapse, ADF, Power BI, ML risk scoring, DQ, governance, and lineage.
Event-driven data pipeline prototype combining batch and streaming processing with Kafka, Redis, and PostgreSQL — built for learning and realistic data-engineering demos using NYC Taxi data.
Data Engineer Training Using Google Cloud Platform
Sanitized ML-based risk scoring pipeline for a Tier-1 UK Retail Bank (GCP + BigQuery ML). Includes Batch/ETL ingestion, feature engineering, BQML training, scoring workflows, governance, lineage, and runbooks. No client code/data.
🔍 Detect compliance anomalies in financial transactions with Azure and Databricks, ensuring accuracy and transparency for audit processes.
🏥 Streamline healthcare claims processing with this Snowflake pipeline, featuring auto-ingestion, CDC, SCD Type 2, and data quality checks.
Add a description, image, and links to the batch-pipeline topic page so that developers can more easily learn about it.
To associate your repository with the batch-pipeline topic, visit your repo's landing page and select "manage topics."