add real world test corpus; work on some parse errors and weirdnesses

This commit is contained in:
mhoffm
2021-06-19 16:56:35 +02:00
parent fa9b0307c6
commit 5f7a5b5e98
900 changed files with 16442 additions and 9184 deletions
+1
View File
@@ -0,0 +1 @@
example/real_world_stuff/* filter=git-crypt diff=git-crypt
+1
View File
@@ -3,6 +3,7 @@ queries
package-lock.json package-lock.json
build build
npm-debug.log npm-debug.log
log.html
tree-sitter-hcl.wasm tree-sitter-hcl.wasm
.env .env
.DS_Store .DS_Store
+16
View File
@@ -16,6 +16,22 @@ It is recommended to use `nix` to fulfill all development dependencies. To activ
To run tests simply run `nix-shell --run 'tree-sitter test'`. To run tests simply run `nix-shell --run 'tree-sitter test'`.
## Compliance
The directory `example/real_world_stuff` contains a corpus of hcl files that I found with the github query `user:hashicorp language:HCL`. Just to be sure I encrypted them using `git-crypt`.
Given that some language features are still missing ( see TODO ) there are some expected parse errors:
```bash
nix-shell --run 'tree-sitter parse --quiet --stat example/real_world_stuff/*'
...
...
Total parses: 886; successful parses: 801; failed parses: 85; success percentage: 90.41%
```
The aim is to build unit testcases from selected failure classes and 100%.
## Todo ## Todo
* [ ] use [Unicode® Standard Annex #31](https://www.unicode.org/reports/tr31/) (augmented with '-') for identifiers * [ ] use [Unicode® Standard Annex #31](https://www.unicode.org/reports/tr31/) (augmented with '-') for identifiers
Binary file not shown.
Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More