dashboard:Advanced Features‚ÄãLogging: Log all your LLM requests automatically by sending them through Portkey. Each request log contains timestamp, model name, total cost, request time, request json, response json, and additional Portkey features.Tracing: Trace id can be passed along with each request and is visibe on the logs on Portkey dashboard. You can also set a distinct trace id for each request. You can append user feedback to a trace id as well.Caching: Respond to previously served customers queries from cache instead of sending them again to OpenAI. Match exact strings OR semantically similar strings. Cache can save costs and reduce latencies by 20x.Retries: Automatically reprocess any unsuccessful API requests upto 5 times. Uses an exponential backoff strategy, which spaces out retry attempts to prevent network overload.Tagging: Track and audit each user interaction in high detail with predefined tags.FeatureConfig KeyValue (Type)Required/OptionalAPI Keyapi_keyAPI Key (string)‚úÖ RequiredTracing Requeststrace_idCustom string‚ùî OptionalAutomatic Retriesretry_countinteger [1,2,3,4,5]‚ùî OptionalEnabling Cachecachesimple OR semantic‚ùî OptionalCache Force Refreshcache_force_refreshTrue‚ùî OptionalSet Cache Expirycache_ageinteger (in seconds)‚ùî OptionalAdd Useruserstring‚ùî OptionalAdd Organisationorganisationstring‚ùî OptionalAdd Environmentenvironmentstring‚ùî OptionalAdd Prompt (version/id/string)promptstring‚ùî OptionalEnabling all Portkey Features:‚Äãheaders = Portkey.Config(        # Mandatory    api_key="<PORTKEY_API_KEY>",          # Cache Options    cache="semantic",                     cache_force_refresh="True",                 cache_age=1729,      # Advanced    retry_count=5,                                               trace_id="langchain_agent",                              # Metadata    environment="production",            user="john",                          organisation="acme",                 prompt="Frost"    )For detailed information
Portkey is a platform designed to streamline the deployment
Portkey is a platform designed to streamline the deployment ->: dashboard:Advanced Features‚ÄãLogging: Log all your LLM requests automatically by sending them through Portkey. Each request log contains timestamp, model name, total cost, request time, request json, response json, and additional Portkey features.Tracing: Trace id can be passed along with each request and is visibe on the logs on Portkey dashboard. You can also set a distinct trace id for each request. You can append user feedback to a trace id as well.Caching: Respond to previously served customers queries from cache instead of sending them again to OpenAI. Match exact strings OR semantically similar strings. Cache can save costs and reduce latencies by 20x.Retries: Automatically reprocess any unsuccessful API requests upto 5 times. Uses an exponential backoff strategy, which spaces out retry attempts to prevent network overload.Tagging: Track and audit each user interaction in high detail with predefined tags.FeatureConfig KeyValue (Type)Required/OptionalAPI Keyapi_keyAPI Key (string)‚úÖ RequiredTracing Requeststrace_idCustom string‚ùî OptionalAutomatic Retriesretry_countinteger [1,2,3,4,5]‚ùî OptionalEnabling Cachecachesimple OR semantic‚ùî OptionalCache Force Refreshcache_force_refreshTrue‚ùî OptionalSet Cache Expirycache_ageinteger (in seconds)‚ùî OptionalAdd Useruserstring‚ùî OptionalAdd Organisationorganisationstring‚ùî OptionalAdd Environmentenvironmentstring‚ùî OptionalAdd Prompt (version/id/string)promptstring‚ùî OptionalEnabling all Portkey Features:‚Äãheaders = Portkey.Config(        # Mandatory    api_key="<PORTKEY_API_KEY>",          # Cache Options    cache="semantic",                     cache_force_refresh="True",                 cache_age=1729,      # Advanced    retry_count=5,                                               trace_id="langchain_agent",                              # Metadata    environment="production",            user="john",                          organisation="acme",                 prompt="Frost"    )For detailed information