Commit Graph

672 Commits

Author SHA1 Message Date
Danny Steenman
5500fa2bc5 feat: support for iam roles for bedrock client (#2632)
* feat: implement iam role auth for bedrock

* fix: make client refreshes properly when switching between iam_user and iam_role

* checkout agent flow

* fix aiprovider for bedrock in agent use

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-05-06 13:48:15 -07:00
Tristan Stahnke
b64a77f29f Refactor AWS Bedrock Provider for Multi-modal Support & Correct Token Limits (#3714)
* Fixed two primary issues discovered while using AWS Bedrock with Anthropic Claude Sonnet models:
- Context Window defaults to 8192 maximum, which isn't correct
- Multimodal stopped working when removing langchain, which was transparently handling image_url to a format sonnet expects.

* Ran `yarn lint`

* Updated .env.example to have aws bedrock examples too

* Refactor for readability
move utils for AWS specific functionality to subfile
add token output max to ENV so setting persits

---------

Co-authored-by: Tristan Stahnke <tristan.stahnke+gpsec@guidepointsecurity.com>
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-05-06 12:55:24 -07:00
timothycarambat
ae092b4d4a openai filter other niche models 2025-05-05 12:07:48 -07:00
Sean Hatfield
78e6117dd8 Filter image models from OpenAI (#3768)
filter image models from openai llm provider
2025-05-05 12:01:04 -07:00
Sebastián Darío Ramírez
4f23e44756 Add gemini-embedding-exp-03-07 model support (#3767)
* adds gemini-embedding-exp-03-07 support

* unset random changes, make model map

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-05-05 09:37:01 -07:00
Sean Hatfield
8912d0f0fc Add option to control KoboldCPP max response tokens (#3746)
add option to control koboldcpp max response tokens
2025-05-02 14:12:06 -07:00
ALEKSEY KAPUSTYANENKO
e93964b67b #3707 added sse and streamable stransport support for mcp servers (#3747)
* #3707 added sse and streamable stransport support for mcp servers

* #3707 yarn lint changes

* bump MCP SDK to latest

* option chain transport

* small refactor

---------

Co-authored-by: Aleksey Kapustyanenko <kapustyanenko@mercurydevelopment.com>
Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-05-02 14:09:25 -07:00
timothycarambat
62627fca7f add preUpdate checks on updateENV 2025-04-29 14:44:23 -07:00
timothycarambat
15acb19a68 Telemetry offset disabled count 2025-04-29 14:10:59 -07:00
timothycarambat
dacd67124a Prune telemetry events
Update telemetry for model tagging
Update readme on telemetry
2025-04-29 13:54:00 -07:00
Timothy Carambat
f9ef5840cb Remove @google/generative-ai from AnythingLLM (#3740)
* Remove  from AnythingLLM
Migrate to full use of OpenAI Compatible endpoints'
resolves #3618

* lint
2025-04-29 11:39:56 -07:00
Shinya Suzuki
cd900f9e4c Replace @azure/openai with openai, and update openai to version 4.95.1 (#3691)
* Replace @azure/openai to OpenAI lib

* Remove @azure/openai dependency and update openai to version 4.95.1

* linting

* update logging
fix translation dictionary error

* remove bad ENV key that DNE
linting
Patch Azure OpenAI
Migrate Azure Agent provider to use OpenAI Schema for tool calling performance

* unset

* migrate azure to use default OAI stream handler

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-04-29 11:21:39 -07:00
Sean Hatfield
610bdd4673 Allow custom headers in upload-link endpoint (#3695)
* allow custom headers in upload-link endpoint

* override loader.scrape to allow for passing of headers in langchain puppeteer

* lint

* Rename some variables
move positional args to named args
update documentation to reflect arg changes and funciton sigs
validate header object before attempting to end to forward to request

* update header validation for custom headers

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-04-22 12:47:12 -07:00
Timothy Carambat
1601eb986c Enable bypass of ip limitations via ENV in collector processing (#3652)
* Enable bypass of ip limitations via ENV in collector startup
resolves #3625
connect #3626

* dev build

* bump dockerx build action

* enable runtime setting config of collector requests

* comments and linting for option passing

* unset

* unset

* update docs link

* linting and docs
2025-04-21 11:10:41 -07:00
Timothy Carambat
fd4929b4d2 Feature/drupalwiki collector (#3693)
* Implement DrupalWiki collector

* Add attachment downloading and processing functionality (#3)

* linting

* Linting
Add citation image
small refactors
add URL for citation identifier

---------

Co-authored-by: em <eugen.mayer@kontextwork.de>
Co-authored-by: rexjohannes <53578137+rexjohannes@users.noreply.github.com>
Co-authored-by: Eugen Mayer <136934+EugenMayer@users.noreply.github.com>
2025-04-21 09:17:24 -07:00
Timothy Carambat
05ced11650 Add support for /v1/document/upload* endpoints to support auto-add to workspace (#3692) 2025-04-21 08:28:33 -07:00
Timothy Carambat
7afbc6d11b enable MCP tool use via @agent in API calls (#3683)
* enable MCP tool use via `@agent` in API calls

* relocate import
2025-04-20 14:49:22 -07:00
Timothy Carambat
a76ee21703 Handle env override for PATH and other defaults when env is specific (#3676)
* dev build
auto merge MCP PATH and NODE_PATH

* remove log
2025-04-18 12:44:48 -07:00
timothycarambat
f176a294f5 remove hard-coded token limit check
resolves #3674
2025-04-18 12:05:45 -07:00
Shinya Suzuki
98c46c04e4 Update Azure AI options and model map with new model configurations (#3660)
* Update Azure AI options and model map with new model configurations

* linting

---------

Co-authored-by: Shinya Suzuki <shinya.s.825@gmail.com>
Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-04-16 09:08:40 -07:00
timothycarambat
1d1fb817b0 linting 2025-04-15 12:51:08 -07:00
Michał Rudziński
be27299897 handling of citations in openRouter provider #3581 (#3620)
* handling of citations in openRouter provider #3581

* Update pplx enrichToken function comment
Modify OR enrichToken to be generic handler function with optional params
handle _just_ Perplexity in-line citations since no other models support this functionality

* remove console log

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-04-15 10:57:09 -07:00
timothycarambat
1359151dd6 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-04-14 13:54:50 -07:00
Sean Hatfield
15f524ca37 Fix customize logo bug (#3628)
fix customize logo bug on first setup

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-04-14 11:51:04 -07:00
timothycarambat
9a14535cf4 update gitignore 2025-04-09 15:40:45 -07:00
Timothy Carambat
1b59295f89 Refactor Gemini to use OpenAI interface API (#3616)
* Refactor Gemini to use OpenAI interface API

* add TODO

* handle errors better (gemini)

* remove unused code
2025-04-07 17:18:31 -07:00
Timothy Carambat
699684e301 Disable Agent retry to prevent looping on crash (#3617) 2025-04-07 16:44:21 -07:00
Timothy Carambat
4ac900f645 Gemini model list sync (#3609)
* Update defaultModels.js

add gemma-3-27b-it to v1BetaModels

* Update defaultModels.js

20250330 model update

* Update defaultModels.js

remove text embedding

* Update name and inputTokenLimit modelMap.js

* Update gemini to load models from both endpoints
dedupe models
decide endpoint based on expieremental status from fetch
add util script for maintainers
reduce cache time on gemini models to 1 day

* remove comment

---------

Co-authored-by: DreamerC <dreamerwolf.tw@gmail.com>
2025-04-07 13:45:16 -07:00
timothycarambat
56eb74c664 optional "env" in MCP config 2025-04-06 13:41:17 -07:00
Sean Hatfield
59aa301e9a Fix agent flow description bug (#3593)
* fix agent flow description bug

* add jsdoc to AgentFlows class

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-04-03 17:30:08 -07:00
Sean Hatfield
2e947050df Allow period in username (#3592)
* allow period in username

* update validation hint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-04-03 16:42:39 -07:00
Timothy Carambat
7a01298a8e ModelContextProtocol (MCP) Full Compatibility (#3547)
* WIP MCP full compatibility layer

* implement MCP agent function wrapping and invocation methods

* Add `uvx` to docker bin for MCP executions

* dev build

* prune removed data

* Wrap MCP servers to lazy load items to not block the UI
Mobile bug fixes

* arm64 test build

* reset dev builder

* remove unused prop
2025-03-31 16:15:19 -05:00
Timothy Carambat
1c905b1105 Replace connectionString parser for sql-agent (#3560)
resolves #3551
2025-03-28 12:46:21 -07:00
Timothy Carambat
b6698ff89e Persist images attached in API requests to the UI for rendering (#3546)
Persist images attached in API requests to the UI for rendereing
resolves #3518
2025-03-26 14:16:12 -07:00
Timothy Carambat
4d06884a36 add AgentFlow execution via API chat invocation (#3545)
* add AgentFlow execution via API chat invocation

* reorder import
2025-03-26 13:57:26 -07:00
Timothy Carambat
78c83383d8 Overhaul AWS Bedrock provider (#3537)
* Patch AWS Bedrock provider for newer models and performance

* patch prompt constructor
2025-03-25 15:58:16 -07:00
Shixian Sheng
dd701f9aa4 Update QDRANT_SETUP.md (#3530) 2025-03-25 12:45:18 -07:00
Sean Hatfield
f3ea21bcd1 Prompt variables (#3359)
* wip prompt variables

* refactor backend + add popup suggestions menu to frontend

* use processString to replace all variables in system prompts

* update translations

* fix translations

* wip highlight variables

* revert accidental name change

* rename everything, remove translations

* Update prompt var UI and backend logic

* Update form handler
linting

* linting

* normalize all translation files for prompt variables

* prompt vars dev image

---------

Co-authored-by: Timothy Carambat <rambat1010@gmail.com>
2025-03-25 12:44:19 -07:00
Sean Hatfield
f0b7919a8f Protected slash command check (#3524)
* protected slash command check

* fix error handling on frontend

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-24 17:09:36 -07:00
Sean Hatfield
5785a705cf Enable use of @agent in slash commands (#3508)
* allow @agent in slash commands

* make prompt input focused on slash command click

* lint

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-24 11:35:48 -07:00
Sean Hatfield
19ba6bcc15 Enable slash commands in dev API chat/stream-chat (#3514)
* enable slash commands in dev api

* lint

* Remove ability to use default slash commands in API request
Add `reset` param to body that can reset chats according to the api chat execution parameters
Allow null `message` if `reset` is set in request.
Added early return for if message is null and reset is true
Enable chat to reset chat history and continue `message` execution
Added generic WorkspaceChat history reset function. Deprecated others

* update grep function comment
remove debug

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-24 11:29:36 -07:00
timothycarambat
0d1a2f06aa remove dupe key 2025-03-20 11:16:40 -07:00
Sean Hatfield
688ade6d96 Bump LanceDB (#3015)
* bump lancedb

* dev build

* normalize build

* wtf is going on with build now

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-20 10:00:38 -07:00
Timothy Carambat
b54ab7be05 CHORE: debounce telems to prevent spamming (#3505)
debounce telems to prevent spamming
2025-03-20 08:40:28 -07:00
Sean Hatfield
e01c0dff04 Fix embedding endpoint for OpenAI compatible API (#3467)
* fix embedding endpoint for openai compatible api

* remove unused imports

* add backwards compat for embedding

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-17 18:10:24 -07:00
Sean Hatfield
f6239a39f8 fix chroma db + add similarity offset (#3458)
* fix chroma db + add similarity offset

* patch chroma scoring

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-17 17:48:23 -07:00
timothycarambat
0d5e869f5c Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-03-17 17:47:55 -07:00
timothycarambat
0c34d62342 fix pkg order 2025-03-17 17:47:48 -07:00
Sean Hatfield
5658aac25c Add remove folder developer API endpoint (#3489)
* add remove folder api endpoint

* update purgeFolder function comment

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2025-03-17 17:05:21 -07:00
timothycarambat
0b1a0e0a1f Merge branch 'master' of github.com:Mintplex-Labs/anything-llm 2025-03-04 09:08:21 -08:00