csvfix - CSVfix is a tool for manipulating CSV data

Project Information

Project feeds
Code license
MIT License
Labels
csv, editor, database, data, batch, cplusplus, windows, excel, utility, sql, convert, linux, unix, xml

Members

nbutterworth1953@gmail.com

Featured

Downloads

Wiki pages

Links

Blogs
Late Developer
External links
CSVfix Manual
CSVtest
nclip
Groups
CSVfix Support Forum

News: Version 1.3 released. From this release I will no longer be providing a zipped snapshot of the source code. Linux users (and others that need the source) can still get a zip via the Bitbucket clone at https://bitbucket.org/neilb/csvfix/src.

News: I have cloned the CSVfix source repository on Bitbucket at https://bitbucket.org/neilb/csvfix/src - this is a slightly more convenient way of getting the up-to-date source code than using Google Code, as you don't need to have Mercurial installed. Simply select your preferred zip format from the "get source" menu.

News: Added full instructions on building CSVfix on Windows to Wiki.

The Problem

If you have any dealings at all with data and databases, then you almost certainly will have have to deal with comma-separated values (CSV) data. Unfortunately, the CSV files you are given, or are required to produce, never seem to be in quite the right format for your particular business application. And because of the structure of CSV records, using standard text processing tools like sed, awk and perl on CSV files is not as simple as it might be.

The Solution

CSVfix is a command-line tool specifically designed to deal with CSV data. With it you can, among other things:

Convert fixed format, multi-line and DSV files to CSV
Reorder, remove, split and merge fields
Convert case, trim leading & trailing spaces
Search for specific content using regular expressions
Filter out duplicate data or data on exclusion lists
Perform sed/perl style editing
Enrich with data from other sources
Add sequence numbers and file source information
Split large CSV files into smaller files based on field contents
Perform arithmetic calculations on individual fields
Validate CSV data against a collection of validation rules
Convert between CSV and fixed format, XML, SQL and DSV
Summarise CSV data, calculating averages, modes, frequencies etc.

You can see a full list of CSVfix commands here. You can view the CSVfix manual here. For questions and support on CSVfix, please use the support forum - particularly, please post there before raising an issue in the issue tracker.

CSVfix is available as a Windows binary installer, or in source form for both Windows and Linux/Unix platforms.