Parsing Gigantic JSON Text

Kevin Feasel

2017-02-20

JSON

Jovan Popvic has created a 4.35 GB JSON array:

SQL Server 2016 and Azure SQL Database enable you to parse JSON text and transform it into tabular format. In this post, you might see that JSON functions can handle very large JSON text – up to 4GB.

First, I would need very large JSON document. I’m using TPCH database so I will export the content of lineitem table in a file. JSON can be exported using the bcp.exe program:

My first draft read “Jovan Popovic has created a monster.”  I might go back to that one.  On the plus side, the operation took a lot less time than I had expected, though I’d have to imagine that his SQL Express instance had some decent specs.

Related Posts

Matrix Operations with JSON

Phil Factor takes a look at using JSON to perform memoization: For the SQL Server developer, matrices are probably most valuable for solving more complex string-searching problems, using Dynamic Programming. Once you get into the mindset of this sort of technique, a number of seemingly-intractable problems become easier.  Here are fifty common data structure problems that can be […]

Read More

Searching Complex JSON With SQL Server

Kevin Feasel

2019-02-27

JSON

Bert Wagner gives us a way that you can quickly search through complicated JSON: Computed column indexes make querying JSON data fast and efficient, especially when the schema of the JSON data is the same throughout a table. It’s also possible to break out a well-known complex JSON structure into multiple SQL Server tables. However, what […]

Read More

Categories

February 2017
MTWTFSS
« Jan Mar »
 12345
6789101112
13141516171819
20212223242526
2728