Skip to content

mwh/jqjs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

92 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

jqjs is a JavaScript implementation of the jq query language. It implements the core language features in pure JavaScript.

The main entry point to jqjs is the compile function, which turns a jq program string into a generator function:

import jq from './jq.js'
let filter = jq.compile(".x[].y")
for (let v of filter({x:[{y:2}, {y:4}]}) { ... }

The module also has a prettyPrint function for rendering an object to text.

As a shorthand, the default export is itself callable in two ways:

let filter = jq('.x[].y')
for (let x of filter(obj)) { ... }

for (let x of jq('.x[].y', obj)) { ... }

With a single argument, this is equivalent to jq.compile, and with two arguments it is equivalent to jq.compile(arg1)(arg2).

Features

jqjs supports most of the core jq language features, but lacks functions and some of the advanced functionality. It also uses JavaScript strings as backing, so does not have jq proper's Unicode support.

  • Identity: .
  • Object Identifier-Index: .foo, .foo.bar
  • Generic Object Index: .[<string>]
  • Array Index: .[2]
  • Array/String Slice: .[10:15]
  • Array/Object Value Iterator: .[]
  • Comma: ,
  • Pipe: |
  • Parentheses: (...)
  • Array Construction: [...]
  • Object Construction: { ... } including shorthand { user, title } and computed keys { (.x): true }
  • Recursive Descent: ..
  • Addition, subtraction, multiplication, division, and modulo, including the overloaded type operations.
  • Named functions
    • Built-in functions
      • tostring, tonumber, toboolean, tojson, fromjson
      • length, keys, has, in, type, del
      • empty, select, arrays, objects, booleans, numbers, strings, nulls
      • map, map_values, sort, sort_by, explode, implode, split, join
      • add, add/1
      • to_entries, from_entries, with_entries, walk/1
      • range/1, range/2, range/3
      • any/0, any/1, any/2, all/0, all/1, all/2
      • contains, inside
      • path, getpath/1, setpath/2, delpaths/1, pick/1
      • trim/0, ltrim/0, rtrim/0, trimstr/1, ltrimstr/1, rtrimstr/1
      • first, last, nth/1, first/1, last/1, nth/2, limit/2, skip/2
      • sub/1, sub/2, gsub/1, gsub/2, test/1, test/2, split/2
      • capture/1, capture/2, match/1, match/2, splits/1, splits/2
      • ascii_upcase/1, ascii_downcase/1
      • the others
    • User-defined functions
    • Mathematical functions
    • Date functions
    • SQL-style operators
  • String interpolation: \(foo)
  • Format strings and escaping: @text, @json, @html, @uri, @csv, @tsv, @sh, @base64, @base64d
    • Format interpolations: @uri "https://google.com/search?q=\(.x)"
  • Equality checks: ==, !=
  • Comparisons: <, >, <=, >=
    • Correct sorting order for unequal types (null < 7, [] < {})
  • Conditionals: if A then B elif C then D else E end
  • Alternative operator: //
  • Try-catch: try EXP catch EXP
    • Error Suppression operator ?
  • Regular expressions (uses JavaScript RegExp, so behaviour is incomplete)
  • Variable/Symbolic Binding Operator ... as $identifier | ...
  • Reduce: reduce .[] as $item (0; . + $item)
  • foreach: foreach .[] as $item (...;...;...)
  • Recursion: recurse(.children[])
  • I/O (unlikely to make sense here)
  • Update-assignment: .posts[].comments |= . + ["Another"]
  • Arithmetic update-assignment: +=, -=, *=, /=, %=, //=
  • Plain assignment: (.a,.b) = range(2)
  • Modules with import and include

Installing and using

The jq.js module can be imported and used directly:

import jq from "./jqjs.js";

but this library can also be installed through npm:

npm install @michaelhomer/jqjs

then

import jq from "@michaelhomer/jqjs";
// or
const jq = require("@michaelhomer/jqjs");

Or

npm install mwh/jqjs

then

import jq from "jqjs/jq.js";
// or
const jq = require("jqjs/jq.js");

After that

let func = jq.compile(".x[].y")

will create a func function that can be given any JavaScript object to process, and will return an iterator producing each output of the jq program:

for (let v of filter({x:[{y:2}, {y:4}]}) { ... }

will run the loop body with v holding 2, then 4, then stop.

func also exposes the jq syntax tree (as func.filter) and a function returning a complete trace of the output of every component of the jq program (func.trace({x:[{y:2}, {y:4}]})) as nested arrays and objects.

Performance

Not great.

The intention is to be semantically correct first and to have clear code second. Performance improvements sit after that, if at all. Executing a program may reëvaluate parts of it or traverse the object multiple times where that makes things simpler, and internally evaluation happens by tree-walking the input syntax.

Demonstration

demo.html is a live demo of how to use jqjs that lets you enter a jq program and an input JSON value and see the output JSON values it produces.

A demonstration of the tracing functionality from the paper "Branching Compositional Data Transformations in jq, Visually" is also available.

About

Pure-JavaScript implementation of the jq JSON query language

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 3

  •  
  •  
  •