Every little gist

Home

This site contains information/documentation for my codes in my Github repositories & my notes from self-learning various topics.

Mainly contains stuff related to machine learning, market microstructure, CI/CD web development & stuff with not so trivial details that I will most probably forget over time.

Checkout my Github.


Recent posts

DPPO distributed tensorflow

68 minute read

This post documents my implementation of the Distributed Proximal Policy Optimization (Distributed PPO or DPPO) algorithm. (Distributed continuous version)

A3C distributed tensorflow

26 minute read

This post documents my implementation of the A3C (Asynchronous Advantage Actor Critic) algorithm (Distributed discrete version).

Distributed Tensorflow

76 minute read

This post demonstrates a simple usage example of distributed Tensorflow with Python multiprocessing package.

N-step targets

76 minute read

This post documents my implementation of the N-step Q-values estimation algorithm.