This project contains the 3 lab exercises for the course "High Performance Systems Programming" focused on parallel and high-performance computing using MPI, OpenMP, GPU offloading, and Python multiprocessing.
- OpenMP
- CPU multi-threading
- Task-based initialization
- GPU offloading
- MPI (Message Passing Interface)
- Point-to-point communication
- Hybrid programming with OpenMP + MPI
- AVX (Advanced Vector Extensions)
- Vectorized operations using AVX intrinsics
- SIMD-level optimization for matrix operations
- GPU Programming
- OpenMP Offloading
- GPU acceleration using CUDA
- Python for HPC
- Multiprocessing
- MPI for Python
- Master-worker implementation of distributed grid search