Eric J Ma's Website

« 26 27 28 29 30 »

Parallel Processing with Dask on GridEngine Clusters

written by Eric J. Ma on 2018-10-11 | tags: parallel dask gridengine data science optimization

I recently just figured out how to get this working... and it's awesome! :D

Motivation

If I'm developing an analysis in the Jupyter notebook, and I have one semi-long-running function (e.g. takes dozens of seconds)... (read more)

(2011 words, approximately 11 minutes reading time)
Optimizing Block Sparse Matrix Creation with Python

written by Eric J. Ma on 2018-09-04 | tags: graph optimization numba python data science sparse matrix

Introduction

At work, I recently encountered a neat problem. I'd like to share it with you all.

One of my projects involves graphs; specifically, it involves taking individual graphs and turning them into one big... (read more)

(1255 words, approximately 7 minutes reading time)
3D Printed WiFi Access QR Codes: Part 2

written by Eric J. Ma on 2018-09-02 | tags: 3d printing python qr code

Part 2 of how to create 3D-printed QR codes!

Read on... (885 words, approximately 5 minutes reading time)
3D Printed WiFi Access QR Codes: Part 1

written by Eric J. Ma on 2018-09-01 | tags: python qr codes wifi 3d printing security coding technology diy networking home project guest network pyqrcode pypng solidpython numpy click flask

Over the weekend, I embarked on a cool DIY project to create a 3D printed QR code for our guest WiFi network. I used Python and a few packages to generate the QR code. It was a fun, practical project that also satisfied my curiosity about QR codes. Stay tuned for more! 😄👨‍💻📶

Read on... (673 words, approximately 4 minutes reading time)
Joint, conditional, and marginal probability distributions

written by Eric J. Ma on 2018-08-07 | tags: statistics probability bayesian data science

A little cheat sheet to help you remember what joint, conditional, and marginal distributions are.

Read on... (102 words, approximately 1 minute reading time)
d-separation in causal inference

written by Eric J. Ma on 2018-08-06 | tags: causal inference bayesian data science

Yesterday evening, I had an empty block of time during which I finally did a worked example of finding whether two nodes are "d-separated" in a causal graph. It was pretty instructive to implement the algorithm. It also reminded me yet again:... (read more)

(76 words, approximately 1 minute reading time)
nxviz 0.5 released!

written by Eric J. Ma on 2018-08-01 | tags: nxviz visualization data science software open source

A new version of nxviz is released!

In this update, I have added a declarative interface for visualizing geographically-constrained graphs. Here, nodes in a graph have their placement constrained by longitude and latitude.

An example... (read more)

(125 words, approximately 1 minute reading time)
pyjanitor 0.3 released!

written by Eric J. Ma on 2018-07-27 | tags: open source pyjanitor data science

A new release of pyjanitor is out!

Two new features that I have added in include:

  1. Concatenating column names into a single column, such that each item is separated... (read more)

    (149 words, approximately 1 minute reading time)
SciPy 2018

written by Eric J. Ma on 2018-07-26 | tags: scipy conferences python

It's been about two weeks since SciPy 2018 ended, and I've finally found some breathing room to write about it.

SciPy 2018 is the 4th year I've made it to the conference, my first one being SciPy 2015 (not 2014, as I had originally... (read more)

(585 words, approximately 3 minutes reading time)
Bayesian Estimation, Group Comparison, and Workflow

written by Eric J. Ma on 2018-07-16 | tags: bayesian statistics data science

Over the past year, having learned about Bayesian inference methods, I finally see how estimation, group comparison, and model checking build upon each other into this really elegant framework for data analysis.

(read more)

(465 words, approximately 3 minutes reading time)
« 26 27 28 29 30 »