Pandas 0.25.0 is Here. What is New? Named aggregation, explode() and sparse dataframe

If you are like me, you might have missed that the fantastic Pandas team has released the new version Pandas 0.25.0. As one would expect, there are quite a few new things in Pandas 0.25.0. A couple of new enhancements are around pandas’ groupby aggregation. Here are a few new things that look really interesting.… Continue reading Pandas 0.25.0 is Here. What is New? Named aggregation, explode() and sparse dataframe

3 Ways to Read a File and Skip Initial Comments in Python

Reading a text file line by line is one of the common activities you do while dealing with a big text file. Often, you are not interested in initial few lines and want to skip them and work with rest of the file. The initial few lines of the text file that you want to… Continue reading 3 Ways to Read a File and Skip Initial Comments in Python

How to read a numerical data/file in Python with numpy?

Often you may need to read a file containing numerical data in Python for. One of the options is to import the file/data in Python is use Python’s NumPy library. There are number of advantages to use NumPy. NumPy is designed to deal with numerical data, it is fast and it has loads of built-in… Continue reading How to read a numerical data/file in Python with numpy?

Paste command examples in Linux/Mac OS

The Linux command paste is one of the powerful commands that can be used to “merge multiple files in to a single file” and also “collapse multiple lines in a single file to a new file”. Here are some basic examples of using the paste command. Paste command to merge multiple files into a single… Continue reading Paste command examples in Linux/Mac OS

Understanding Variables in Shell Scripting

A number of beautiful and powerful programming languages, like Python, Ruby, and Perl are available for scripting needs. Even then you may find the old school unix shell scripting very useful tool to learn and use. For sure, shell scripts looks crazy and hard to read/understand. Once you get a hang of it, you might… Continue reading Understanding Variables in Shell Scripting