Commit Graph

620 Commits

Author SHA1 Message Date
Timur Gordon
475e812ba3 add mpc inspector example 2025-03-14 02:37:48 +01:00
Timur Gordon
0a953f2c09 add documentation 2025-03-14 02:37:26 +01:00
Timur Gordon
1e26162e00 fix jsonrpc serializations 2025-03-14 02:36:40 +01:00
Timur Gordon
dd68bf950c fix mpc and refactor to make generic server 2025-03-14 02:25:38 +01:00
Timur Gordon
47c95f76e9 Merge branch 'development' into development_actions007 2025-03-13 13:33:46 +01:00
Timur Gordon
918cfd83ec rename old installer client 2025-03-13 13:20:45 +01:00
Timur Gordon
83387c47ec add troubleshooting info for using tcc 2025-03-13 13:07:00 +01:00
Timur Gordon
f6c22c733b rename module imports 2025-03-13 12:59:21 +01:00
Timur Gordon
269d0474c5 add refactored schemas modules from 6-openrpc-code-generator branch 2025-03-13 12:41:35 +01:00
Timur Gordon
28359984ff add case fixing tools 2025-03-13 12:40:50 +01:00
Timur Gordon
c09e424890 refactor and reorganize code modules 2025-03-13 12:39:38 +01:00
a55af220bf ... 2025-03-13 10:56:55 +01:00
9c09af83a2 Merge branch 'development_action007_mahmoud' into development_actions007 2025-03-13 07:15:40 +01:00
e69d67d238 Merge branch 'development_grid_deploy' into development_actions007 2025-03-13 07:15:34 +01:00
01c6ea66ac Merge branch 'development_ourdb_new' into development_actions007 2025-03-13 07:15:27 +01:00
f9ea731a6e Merge branch 'development_actions007' into development_action007_mahmoud
# Conflicts:
#	lib/clients/jina/jina_client.v
#	lib/clients/jina/jina_factory_.v
#	lib/clients/jina/jina_model.v
#	lib/clients/jina/rank_api.v
2025-03-13 07:14:09 +01:00
timurgordon
a974091442 webdav completion wip 2025-03-13 04:34:10 +01:00
Scott Yeager
413b805823 Update caddy gateway example 2025-03-12 17:08:24 -07:00
Scott Yeager
46069ba924 Restore old json encoders 2025-03-12 17:08:00 -07:00
Scott Yeager
f3e7b979a5 QSFS not implemented 2025-03-12 15:53:57 -07:00
Scott Yeager
f6733a67af No const inside funcs 2025-03-12 15:51:59 -07:00
Scott Yeager
4988b241ef Json encoding doesn't mutate 2025-03-12 15:51:44 -07:00
Scott Yeager
7807a8e736 Target correct struct 2025-03-12 15:30:58 -07:00
5ba11aab46 ... 2025-03-12 16:36:17 +01:00
Mahmoud Emad
4abb46b4bf feat: Add Jina server health check
- Added a health check to the Jina client to verify server availability.
- Improved error handling and messaging for failed health checks.
- Enhanced client robustness by providing feedback on server status.
2025-03-12 16:38:38 +02:00
Mahmoud Emad
a7976c45f9 feat: Add multi-vector API support
- Added a new `create_multi_vector` function to the Jina client
  to support creating multi-vector embeddings.
- Added a new `multi_vector_api.v` file containing the
  implementation for the multi-vector API.
- Updated the `jina.vsh` example to demonstrate the usage of the
  new multi-vector API.
2025-03-12 16:16:37 +02:00
Mahmoud Emad
5194fabe62 feat: Add classifier deletion functionality
- Added `delete_classifier` function to delete a classifier by ID.
- Added corresponding unit tests for the new function.
- Updated the client example to demonstrate classifier deletion.
- Renamed `jina_client_test.v` to `api_test.v` for better organization.
- Renamed `model_embed.v` to `embeddings_api.v` for better organization.
- Refactored the embedding API to use enums for task and truncate types,
  and added error handling for invalid inputs.
2025-03-12 14:29:40 +02:00
timurgordon
ff430c2e4d Remove path from fsentry metadata, make vfs and webdav work again with fixes 2025-03-12 02:16:40 +01:00
1581628ea3 Merge branch 'development_action007_mahmoud' into development_actions007 2025-03-11 20:41:52 +01:00
237f9bd742 qdrant 2025-03-11 20:41:33 +01:00
Mahmoud Emad
cf27e7880e feat: Add classifier listing functionality
- Added a new function to list available classifiers.
- Extended the Jina client with `list_classifiers()` method.
- Added unit tests to verify the new functionality.
2025-03-11 21:38:06 +02:00
Mahmoud Emad
ad300c068f feat: Enhance Jina client with improved classification API
- Update `jina.vsh` example to showcase the new classification API
  with support for both text and image inputs. This improves
  the flexibility and usability of the client.
- Introduce new structs `TextDoc`, `ImageDoc`, `ClassificationInput`,
  `ClassificationOutput`, `ClassificationResult`, and `LabelScore`
  to represent data structures for classification requests and
  responses. This enhances code clarity and maintainability.
- Implement the `classify` function in `jina_client.v` to handle
  classification requests with support for text and image inputs,
  model selection, and label specification. This adds a crucial
  feature to the Jina client.
- Add comprehensive unit tests in `jina_client_test.v` to cover
  the new `classify` function's functionality. This ensures the
  correctness and robustness of the implemented feature.
- Remove redundant code related to old classification API and data
  structures from `model_embed.v`, `model_rank.v`, and
  `jina_client.v`. This streamlines the codebase and removes
  obsolete elements.
2025-03-11 21:11:04 +02:00
Mahmoud Emad
1a02dcaf0f feat: Add train functionality to Jina client
- Added a `train` method to the Jina client for training models.
- Added a test case to verify the `train` functionality.
2025-03-11 20:20:46 +02:00
Mahmoud Emad
9ecc2444aa feat: Add Jina client training and classification features
- Added `train` function to the Jina client for training
  classifiers.
- Added `ClassificationTrain` struct to define training
  parameters.
- Added `TrainingExample` struct to represent training data.
- Added `ClassificationTrainOutput` struct for the training
  response.
- Added a new `classification_api.v` module for classifier
  training functionalities.
- Added a new `classify` function to the Jina client for
  classification tasks (currently commented out).
2025-03-11 20:17:35 +02:00
Mahmoud Emad
0e1836c5d0 feat: Add reranking functionality to Jina client
- Added a new `rerank` function to the Jina client for reranking documents.
- Added a new `RerankParams` struct to define parameters for reranking.
- Added unit tests for the new `rerank` function.
- Updated the example script to demonstrate reranking.
- Improved error handling and added more comprehensive logging.
2025-03-11 19:27:01 +02:00
Mahmoud Emad
7965883744 feat: Enhance Jina client with additional embedding parameters
- Add `type_`, `truncate`, and `late_chunking` parameters to the
  `create_embeddings` function for finer control over embedding
  generation. This allows users to specify embedding type,
  truncation method, and whether to apply late chunking.
- Rename model parameter to `model` for clarity and consistency.
- Improve model enum naming for better readability and API consistency.
- Add unit tests for the `create_embeddings` function to ensure
  correct functionality and handle potential errors.
2025-03-11 17:45:55 +02:00
Mahmoud Emad
b006bb1e41 feat: Add create_embeddings function to Jina client
- Added a `create_embeddings` function to the Jina client to
  generate embeddings for given input texts.
- Improved the `create_embeddings` function input parameters
  for better flexibility and error handling.
- Updated `TextEmbeddingInput` struct to handle optional
  parameters for embedding type, truncation type, and late
  chunking.  This improves the flexibility of the embedding
  generation process.
2025-03-11 17:18:47 +02:00
Mahmoud Emad
27c9018c48 fix: Ensure the code compiles and add a test example
- Fixed compilation issues and ensured the code builds successfully
- Created an example to test the client functionality
- Started implementing additional endpoints
2025-03-11 16:49:39 +02:00
Mahmoud Emad
f1991d89b3 feat: Implement database synchronization using binary encoding
- Adds a new mechanism to synchronize the database efficiently
  by serializing updates using binary encoding.  This improves
  performance and reduces bandwidth usage compared to previous methods.

- Introduces `SyncRecord` struct to represent database updates
  for easier handling and serialization.

- Implements `push_updates` to serialize database changes since a
  given index, handling both initial and incremental syncs.

- Implements `sync_updates` to apply received serialized updates
  to the database, robustly handling errors and deletions.
2025-03-11 15:15:19 +02:00
9448ae85cf ... 2025-03-11 14:07:16 +01:00
timurgordon
a64e964d83 Add documentation and tests for model_property.v 2025-03-11 14:03:10 +01:00
Mahmoud Emad
5e321b6b0f feat: Add diagrams and README for OurDB syncer
- Added a diagram explaining the architecture of the OurDB
  syncer, clarifying the interaction between the HTTP server,
  master, and worker nodes.
- Added a README file providing a comprehensive overview of
  the OurDB syncer project, including its architecture,
  features, prerequisites, installation instructions, and usage
  examples.
- Removed outdated Mycelium_Streamer documentation as it's no
  longer relevant to the current project structure.
- Created example scripts for running the database, master,
  and worker components, simplifying the setup and execution of
  the system.
- Added HTTP client and server documentation, clarifying their
  functionalities and interaction with the OurDB system.
2025-03-11 14:49:43 +02:00
b1453e3580 jina specs 2025-03-11 11:23:58 +01:00
3da895083b circle core objects work again 2025-03-11 08:49:47 +01:00
ac583741a4 ... 2025-03-11 08:27:46 +01:00
4358ba6471 ... 2025-03-10 14:31:26 +01:00
46afb63f31 radix tree has now prefix 2025-03-10 09:05:57 +01:00
f773ce168e names 2025-03-10 01:29:15 +01:00
aa79df1fcd models 2025-03-10 01:07:23 +01:00
420c9cb9e5 ... 2025-03-10 00:50:08 +01:00