Arkime is an open source, large scale, full packet capturing, indexing, and database system.
-
Updated
Apr 11, 2026 - C
#
big-data
Here are 5,589 public repositories matching this topic...
🔍 Capture and segment multiview 3D expressions using our Multimodal Visual Geometry Grounded Transformer for enhanced visual comprehension.
visualization python machine-learning big-data ai computer-vision deep-learning tensorflow image-processing pytorch neural-networks supervised-learning data-analysis unsupervised-learning model-training mvggt
-
Updated
Apr 11, 2026 - Python
📈 Build a real-time stock market data pipeline with Snowflake, Kafka, and Power BI for effective analytics and data engineering practices.
python flask big-data plotly power-bi data-engineering fintech apache-kafka dbt real-time-data data-pipeline stock-analysis apache-airflow cloud-data etl-pipeline ci-cd-pipeline modern-data-stack financial-dashboard real-time-dashboard
-
Updated
Apr 11, 2026 - Java
📊 Build a real-time data pipeline for YouTube trending analytics using Kafka, Spark, and Airflow for efficient processing and insightful visualizations.
airflow kafka big-data spark data-engineering spark-structured-streaming etl-pipeline delta-lake streamlit real-time-pipeline medallion-architecture
-
Updated
Apr 11, 2026 - Python
🔍 Query any database from the terminal and optimize data for AI models with ease using usql.
go devops big-data unity extractor postgresql kakoune asdf data-lake database-management sqlite3 parquet asdf-plugin datalake usql sqlbuilder adla sql-client micropython-module
-
Updated
Apr 11, 2026 - TypeScript
YTsaurus is a scalable and fault-tolerant open-source big data platform.
-
Updated
Apr 11, 2026 - C++
🌍 Ingest and transform real-time earthquake data using Azure tools to deliver reliable analytics-ready datasets for insightful decision-making.
big-data azure scheduled-jobs power-bi pyspark data-engineering earthquake-data usgs-api azure-data-factory azure-databricks lakehouse azure-sql-management cloud-data-platform api-integrations medallion-architecture pipeline-orchestration microsoft-fabric adls-gen2 azure-syn
-
Updated
Apr 11, 2026 - Jupyter Notebook
🚀 Enhance your AI prompts effortlessly with Synapse, a dual-platform app that boosts results through intelligent techniques and multi-provider support.
python docker opencv data-science ui scala big-data spark azure websocket odata synapse asyncapi onnx cloudevents serverless-workflow wfms
-
Updated
Apr 11, 2026 - TypeScript
🚴 Visualize real-time availability of Vélib' bike stations in Paris, showing available bikes and empty docks with interactive Mapbox GL.
mysql lists machine-learning database big-data neural-network stats visitor data-analysis paris bike-sharing bt leafletjs mobile-detection velib gorilla-mux velo public-trackers privacy-friendly
-
Updated
Apr 11, 2026 - TypeScript
🌆 Optimize urban management with smart solutions for efficient resource use and enhanced city living, promoting sustainability and innovation.
python opencv big-data numpy grafana jupyter-notebook traffic minio apache-flink apache-kafka apache-nifi apache-zookeeper apache-airflow apache-hive apache-superset github-config streamlit yolov5 apache-hudi seatunnel
-
Updated
Apr 11, 2026 - Makefile
🖥️ Implement the Intel 8086 microprocessor on FPGA with original microcode, featuring a simplified interface and compatibility for seamless integration.
python fish machine-learning statistics big-data deep-learning neural-network functional-programming pattern-matching probability data-visualization data-engineering data-analysis zwave openzwave cv-template z chatgpt
-
Updated
Apr 11, 2026 - JavaScript
🚀 Build high-performance applications with Paimon C++, a native implementation for efficient access to the Paimon datalake format.
c list awesome big-data inference transformer cppcon flink cpp-library data-ingestion onebot table-store nonebot2 ggml streaming-datalake
-
Updated
Apr 11, 2026
🚖 Analyze NYC taxi data to uncover festival trends and predict demand using scalable Big Data techniques with Dask and Apache Spark.
nyc data-science machine-learning big-data transportation jupyter-notebook data-visualization xgboost data-analysis dask feature-engineering predictive-modeling demand-forecasting taxi time-series-analysis public-transport urban-mobility github-config
-
Updated
Apr 11, 2026 - Jupyter Notebook
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
-
Updated
Apr 11, 2026 - Java
📄 Ingest documents into structured datasets for LLMs, ensuring numeric integrity and easy export across multiple frameworks with doc2dataset.
nlp rust cli machine-learning ocr big-data text evaluation dataset document data-pipeline document-processing fine-tuning interleaved multimodal document-understanding 3dcf numguard
-
Updated
Apr 11, 2026 - Rust
ClickHouse® is a real-time analytics database management system
rust embedded sql database big-data ai analytics cpp clickhouse dbms self-hosted distributed olap cloud-native mpp hacktoberfest lakehouse
-
Updated
Apr 11, 2026 - C++
📊 Analyze website traffic and user engagement to optimize marketing strategies and enhance content performance using detailed hourly session data.
html nyc aws data-science machine-learning data-mining options big-data league-of-legends pandas data-visualization tornado celery nse nifty strike-price hacktoberfest-accepted hacktoberfest2022
-
Updated
Apr 11, 2026 - Jupyter Notebook
🚀 Simplify data ingestion with Smart Ingest Kit, a lightweight toolkit that uses intelligent chunking for optimized, layout-aware RAG processes.
big-data data-transformation data-collection data-management real-time-data event-processing data-pipeline workflow-automation data-ingestion data-streaming api-integration data-automation cloud-integration analytics-tools smart-ingest
-
Updated
Apr 11, 2026 - Python
Multilevel data and operation deduplication mechanism (implementation in C++)
-
Updated
Apr 11, 2026 - C++
Improve this page
Add a description, image, and links to the big-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the big-data topic, visit your repo's landing page and select "manage topics."