Dev minor (#1436)
* fix-actions (#1426)
* up
* modify
* add to github path
* Contextual Chunk Enrichment (#1433)
* add semantic chunking
* working
* precommit
* pre-commits
* Entity Deduplication (#1431)
* Modify graphrag prompt (#1421)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* up
* add tests
* Feature/include vectors option document chunks (#1419)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* add option to include vectors in document chunks
* checkin
* update vector
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
* Allow env var to set the default R2R deployment for the dashboard (#1417)
* modify community_summary_prompt function and corresponding prompt
* add tests
* up
* Feature/various documentation tweaks (#1422)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* add option to include vectors in document chunks
* checkin
* update vector
* some various documentation tweaks
* some various documentation tweaks
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
* Graphrag tests (#1418)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* up
* add tests
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* Modify graphrag tests timeouts (#1416)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* modify timeouts
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* feat: Make prompt provider methods asynchronous (comments below) (#1415)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* feat: Make prompt provider methods asynchronous
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* up
* up
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* Add routes, service level methods around conversations (#1420)
* Add routes, service level methods around conversations
* Slight refactor to match project conventions, add JS methods
* Updated JS methods
* JS docs
* Add python
* Update JS user tests
* add deduplication pipe, workflow, api, sdk, cli
* add summary workflow
* bug fixes
* pre-commit
* working
* search working
* adding dedup test files
* modify the update query
* precommit
* more testing
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* Refactor Python SDK for Intellisense, Thread Safety (#1430)
* Refactor Python SDK
* Fix CLI after SDK changes
* Add convo to agent
* Update conversation error handling, JS
* Remove unused, bad import
* Feature/cleanup refactor vector collection (#1432)
* Feature/include vectors option document chunks (#1419)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* add option to include vectors in document chunks
* checkin
* update vector
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
* Allow env var to set the default R2R deployment for the dashboard (#1417)
* Feature/various documentation tweaks (#1422)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* add option to include vectors in document chunks
* checkin
* update vector
* some various documentation tweaks
* some various documentation tweaks
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
* Graphrag tests (#1418)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* up
* add tests
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* Modify graphrag tests timeouts (#1416)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* modify timeouts
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* feat: Make prompt provider methods asynchronous (comments below) (#1415)
* Fix async JSON parsing (#1408)
* Fix async JSON parsing
* Remove score completion from js
* clean up js
* lockfile
* Feature/build custom logger (#1409)
* building a custom logger for r2r
* fix log
* maintain bkwd compat
* Feature/add kg description prompt (#1411)
* add kg desc prompt
* add kg desc prompt
* add kg desc prompt
* fix prompt name
* separate test run freq (#1412)
* separate test run freq
* task_id check fix
* add ingestion docs
* updatet
* add
* rm old prompts
* rm old prompots
* rm old prompts
* rm old prompts
* Prod fixes + enhancements (#1407)
* change default settings back to fp32
* add logging and cache triples
* up
* up
* pre-commit and cleanups
* making community summary prompt async
* up
* up
* revert prompt changes
* up
* up
* modify default
* bump test timeout due to stricter concurrency limits
* bump sleep
* rm ubuntu from windows/mac workflows
* feat: Make prompt provider methods asynchronous
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
* bump pyproject version
* first commit
* towards slimmer vector implementation logic
* up
* iterate
* up
* checkin
* up
* work doc chunks
* working vector search
* working full text search
* remove asyncpg
* passing vector tests
* up
* merge
* rm pytest
* up
* up
* fix delete
* up
* up
---------
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
Co-authored-by: Shreyas Pimpalgaonkar <shreyas.gp.7@gmail.com>
* Add tests + Cleanup (#1437)
* up
* add tests
* test rename to sdk
* up
* fix tests
* typo
* modify chunk enrichment prompt (#1438)
* modify prompt
* up
* Fix type error on port argument of CLI (#1439)
* finish (#1440)
* finish
* up
* fix
* fix
* up
* fix
* final cleanups
* fix naming convention
* fix schema error
* increase timeout
* split graphrag actions
* fix collection exists error
* up (#1442)
* Add error message (#1443)
* up
* sdk fix
* locally testing build
* up docs (#1445)
* checkin work (#1444)
* checkin work
* finish index functionality extension
* fix concurrency
* add alembic (#1446)
* Prompt Tuning (#1447)
* Check in
* Fix after merging dev-minor in
* Ensure to not cause int overflow with hatchet (#1454)
* Bump JS (#1456)
* Ensure to not cause int overflow with hatchet
* bump js
* improve migration implementation (#1452)
* improve migration implementation
* refine migrations to include kg
* add alembic cli
* extend documentation
* extend docs and all that
* Revert change of default behaviour of entities endpoint, docs, tests (#1455)
* change def behavior of entities + delete endpoint
* pre-commit
* add deduplication tests
* Delete graph (#1450)
* up docs
* up
* up
* rename to raw_chunks
* up
* add tests
* up
* up
* change default
* change cli
* separate out deduplication tests
* change run type in the test
* up
* up
* add test concurrency
* up
* rm concurrency groups
* rm dedup tests
* remove json
* tests
* up
* fix lock
* Update postgres.py
* Feature/merge dev minor main (#1457)
* add run without orchestration (#1448)
* add run without orchestration
* bump versions
* bump versions
* bump versions
* fix
* up
* add end points
* add run without orchestration (#1448) (#1458)
* add run without orchestration
* bump versions
* bump versions
* bump versions
* fix
* up
* sync migration changes
* Ensure that we await ingest files in ingest_files method (#1460)
* Nolan/await update files (#1461)
* Ensure that we await ingest files in ingest_files method
* Await update files as well
* Docs changes (#1462)
* up
* up
* up
* up
* fix failed find and replace (#1463)
* fix failed find and replace
* fix
* Fix JS Client for Ingest Chunks (#1464)
* Ensure that we await ingest files in ingest_files method
* Await update files as well
* Fix js client
---------
Co-authored-by: Shreyas Pimpalgaonkar <shreyas.gp.7@gmail.com>
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
emrgnt-cmplxty
bc53dc9c4f