add real world test corpus; work on some parse errors and weirdnesses

This commit is contained in:
mhoffm
2021-06-19 16:56:35 +02:00
parent fa9b0307c6
commit 5f7a5b5e98
900 changed files with 16442 additions and 9184 deletions

1
.gitattributes vendored Normal file
View File

@@ -0,0 +1 @@
example/real_world_stuff/* filter=git-crypt diff=git-crypt

1
.gitignore vendored
View File

@@ -3,6 +3,7 @@ queries
package-lock.json
build
npm-debug.log
log.html
tree-sitter-hcl.wasm
.env
.DS_Store

View File

@@ -16,6 +16,22 @@ It is recommended to use `nix` to fulfill all development dependencies. To activ
To run tests simply run `nix-shell --run 'tree-sitter test'`.
## Compliance
The directory `example/real_world_stuff` contains a corpus of hcl files that I found with the github query `user:hashicorp language:HCL`. Just to be sure I encrypted them using `git-crypt`.
Given that some language features are still missing ( see TODO ) there are some expected parse errors:
```bash
nix-shell --run 'tree-sitter parse --quiet --stat example/real_world_stuff/*'
...
...
Total parses: 886; successful parses: 801; failed parses: 85; success percentage: 90.41%
```
The aim is to build unit testcases from selected failure classes and 100%.
## Todo
* [ ] use [Unicode® Standard Annex #31](https://www.unicode.org/reports/tr31/) (augmented with '-') for identifiers

Binary file not shown.

Binary file not shown.

Binary file not shown.

Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More