awesome-feature-engineering

A curated list of feature engineering techniques for image and text machine learning.

Table of Contents

• Image
• Text
• General

Image

brightness, contrast, saturation

sample implementations

1. mxnet

use cases

1. Updated! My 99.40% solution to Udacity Nanodegree project P2 (Traffic Sign Classification)

spatial transformer

sample implementations

1. Traffic sign recognition with Torch

use cases

1. The power of Spatial Transformer Networks

histogram equalization

sample implementations

1. Traffic signs classification with a convolutional network

use cases

1. Traffic signs classification with a convolutional network

flipping

sample implementations

1. Traffic signs classification with a convolutional network

use cases

1. Traffic signs classification with a convolutional network

rotation and projection

sample implementations

1. Traffic signs classification with a convolutional network

use cases

1. Traffic signs classification with a convolutional network

others

zooming, cropping, panning, minor color changes

Libraries

• imgaug: Image augmentation for machine learning experiments.

Text

stemmer

sample implementations

1. nltk

use cases

1. Q&A With Job Salary Prediction First Prize Winner Vlad Mnih

tf-idf

sample implementations

1. sklearn

use cases

1. Is That a Duplicate Quora Question?

svd

sample implementations

1. sklearn

use cases

1. Is That a Duplicate Quora Question?

PCA

word2vec

sample implementations

1. gensim

use cases

1. Is That a Duplicate Quora Question?
2. Do-it-yourself NLP for bot developers (text classification, entity recognition)

pipeline

• Document Classification with scikit-learn
• use separate bags of words for different attributes of text

## General

general feature engineering

• 特征工程到底是什么？(in Chinese)

• Image augmentation for machine learning experiments.

feature engieering pipelines

• Tips & Tricks for Feature Engineering / Applied Machine Learning
• represent categorical features using 1-of-K encoding

data exploration with Pandas

• Data Wrangling with Pandas
• A Rubric for Data Wrangling and Exploration

feed data to model

1. Is That a Duplicate Quora Question?