Recipes for Filtering CSV¶ ↑

These recipes are specific code examples for specific CSV filtering tasks.

For other recipes, see Recipes for CSV.

All code snippets on this page assume that the following has been executed:

require 'csv'

Contents¶ ↑

• Source and Output Formats

  • Filtering String to String

    • Recipe: Filter String to String parsing Headers

    • Recipe: Filter String to String parsing and writing Headers

    • Recipe: Filter String to String Without Headers

  • Filtering String to IO Stream

    • Recipe: Filter String to IO Stream parsing Headers

    • Recipe: Filter String to IO Stream parsing and writing Headers

    • Recipe: Filter String to IO Stream Without Headers

  • Filtering IO Stream to String

    • Recipe: Filter IO Stream to String parsing Headers

    • Recipe: Filter IO Stream to String parsing and writing Headers

    • Recipe: Filter IO Stream to String Without Headers

  • Filtering IO Stream to IO Stream

    • Recipe: Filter IO Stream to IO Stream parsing Headers

    • Recipe: Filter IO Stream to IO Stream parsing and writing Headers

    • Recipe: Filter IO Stream to IO Stream Without Headers

Source and Output Formats¶ ↑

You can use a Unix-style “filter” for CSV data. The filter reads source CSV data and writes output CSV data as modified by the filter. The input and output CSV data may be any mixture of Strings and IO streams.

Filtering String to String¶ ↑

You can filter one String to another, with or without headers.

Recipe: Filter String to String parsing Headers¶ ↑

Use class method CSV.filter with option headers to filter a String to another String:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
out_string = ''
CSV.filter(in_string, out_string, headers: true) do |row|
  row['Name'] = row['Name'].upcase
  row['Value'] *= 4
end
out_string # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter String to String parsing and writing Headers¶ ↑

Use class method CSV.filter with option headers and out_write_headers to filter a String to another String including header row:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
out_string = ''
CSV.filter(in_string, out_string, headers: true, out_write_headers: true) do |row|
  unless row.is_a?(Array)
    row['Name'] = row['Name'].upcase
    row['Value'] *= 4
  end
end
out_string # => "Name,Value\nFOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter String to String Without Headers¶ ↑

Use class method CSV.filter without option headers to filter a String to another String:

in_string = "foo,0\nbar,1\nbaz,2\n"
out_string = ''
CSV.filter(in_string, out_string) do |row|
  row[0] = row[0].upcase
  row[1] *= 4
end
out_string # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Filtering String to IO Stream¶ ↑

You can filter a String to an IO stream, with or without headers.

Recipe: Filter String to IO Stream parsing Headers¶ ↑

Use class method CSV.filter with option headers to filter a String to an IO stream:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.open(path, 'w') do |out_io|
  CSV.filter(in_string, out_io, headers: true) do |row|
    row['Name'] = row['Name'].upcase
    row['Value'] *= 4
  end
end
p File.read(path) # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter String to IO Stream parsing and writing Headers¶ ↑

Use class method CSV.filter with option headers and out_write_headers to filter a String to an IO stream including header row:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.open(path, 'w') do |out_io|
  CSV.filter(in_string, out_io, headers: true, out_write_headers: true ) do |row|
    unless row.is_a?(Array)
      row['Name'] = row['Name'].upcase
      row['Value'] *= 4
    end
  end
end
p File.read(path) # => "Name,Value\nFOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter String to IO Stream Without Headers¶ ↑

Use class method CSV.filter without option headers to filter a String to an IO stream:

in_string = "foo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.open(path, 'w') do |out_io|
  CSV.filter(in_string, out_io) do |row|
    row[0] = row[0].upcase
    row[1] *= 4
  end
end
p File.read(path) # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Filtering IO Stream to String¶ ↑

You can filter an IO stream to a String, with or without headers.

Recipe: Filter IO Stream to String parsing Headers¶ ↑

Use class method CSV.filter with option headers to filter an IO stream to a String:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.write(path, in_string)
out_string = ''
File.open(path) do |in_io|
  CSV.filter(in_io, out_string, headers: true) do |row|
    row['Name'] = row['Name'].upcase
    row['Value'] *= 4
  end
end
out_string # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter IO Stream to String parsing and writing Headers¶ ↑

Use class method CSV.filter with option headers and out_write_headers to filter an IO stream to a String including header row:

in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.write(path, in_string)
out_string = ''
File.open(path) do |in_io|
  CSV.filter(in_io, out_string, headers: true, out_write_headers: true) do |row|
    unless row.is_a?(Array)
      row['Name'] = row['Name'].upcase
      row['Value'] *= 4
    end
  end
end
out_string # => "Name,Value\nFOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter IO Stream to String Without Headers¶ ↑

Use class method CSV.filter without option headers to filter an IO stream to a String:

in_string = "foo,0\nbar,1\nbaz,2\n"
path = 't.csv'
File.write(path, in_string)
out_string = ''
File.open(path) do |in_io|
  CSV.filter(in_io, out_string) do |row|
    row[0] = row[0].upcase
    row[1] *= 4
  end
end
out_string # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Filtering IO Stream to IO Stream¶ ↑

You can filter an IO stream to another IO stream, with or without headers.

Recipe: Filter IO Stream to IO Stream parsing Headers¶ ↑

Use class method CSV.filter with option headers to filter an IO stream to another IO stream:

in_path = 't.csv'
in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
File.write(in_path, in_string)
out_path = 'u.csv'
File.open(in_path) do |in_io|
  File.open(out_path, 'w') do |out_io|
    CSV.filter(in_io, out_io, headers: true) do |row|
      row['Name'] = row['Name'].upcase
      row['Value'] *= 4
    end
  end
end
p File.read(out_path) # => "FOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter IO Stream to IO Stream parsing and writing Headers¶ ↑

Use class method CSV.filter with option headers and out_write_headers to filter an IO stream to another IO stream including header row:

in_path = 't.csv'
in_string = "Name,Value\nfoo,0\nbar,1\nbaz,2\n"
File.write(in_path, in_string)
out_path = 'u.csv'
File.open(in_path) do |in_io|
  File.open(out_path, 'w') do |out_io|
    CSV.filter(in_io, out_io, headers: true, out_write_headers: true) do |row|
      unless row.is_a?(Array)
        row['Name'] = row['Name'].upcase
        row['Value'] *= 4
      end
    end
  end
end
p File.read(out_path) # => "Name,Value\nFOO,0000\nBAR,1111\nBAZ,2222\n"

Recipe: Filter IO Stream to IO Stream Without Headers¶ ↑

Use class method CSV.filter without option headers to filter an IO stream to another IO stream:

in_path = 't.csv'
in_string = "foo,0\nbar,1\nbaz,2\n"
File.write(in_path, in_string)
out_path = 'u.csv'
File.open(in_path) do |in_io|
  File.open(out_path, 'w') do |out_io|
    CSV.filter(in_io, out_io) do |row|
      row[0] = row[0].upcase
      row[1] *= 4
    end
  end
end
p File.read(out_path) # => "FOO,0000\nBAR,1111\nBAZ,2222\n"