title: Giant Activity-Induced Stress Plateau in Entangled Polymer Solutions

abstract: We study the viscoelastic properties of highly entangled, flexible, self-propelled polymers using Brownian dynamics simulations. Our results show that the active motion of the polymer increases the height of the stress plateau by orders of magnitude due to the emergence of grip forces at entanglement points. Identifying the activity-induced energy of a single polymer and the ratio of polymer length to self-propulsion velocity as relevant energy and time scales, we find the stress autocorrelation functions collapse across P\'eclet numbers. We predict that the long-time viscosity scales with polymer length squared $\sim L^2$, in contrast to equilibrium counterparts $\sim L^3$. These insights offer prospects for designing new materials with activity-responsive mechanical properties.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.comp-ph


title: Small-Disturbance Input-to-State Stability of Perturbed Gradient Flows: Applications to LQR Problem

abstract: This paper studies the effect of perturbations on the gradient flow of a general nonlinear programming problem, where the perturbation may arise from inaccurate gradient estimation in the setting of data-driven optimization. Under suitable conditions on the objective function, the perturbed gradient flow is shown to be small-disturbance input-to-state stable (ISS), which implies that, in the presence of a small-enough perturbation, the trajectories of the perturbed gradient flow must eventually enter a small neighborhood of the optimum. This work was motivated by the question of robustness of direct methods for the linear quadratic regulator problem, and specifically the analysis of the effect of perturbations caused by gradient estimation or round-off errors in policy optimization. We show small-disturbance ISS for three of the most common optimization algorithms: standard gradient flow, natural gradient flow, and Newton gradient flow.


title: Graph data modelling for outcome prediction in oropharyngeal cancer patients

abstract: Graph neural networks (GNNs) are becoming increasingly popular in the medical domain for the tasks of disease classification and outcome prediction. Since patient data is not readily available as a graph, most existing methods either manually define a patient graph, or learn a latent graph based on pairwise similarities between the patients. There are also hypergraph neural network (HGNN)-based methods that were introduced recently to exploit potential higher order associations between the patients by representing them as a hypergraph. In this work, we propose a patient hypergraph network (PHGN), which has been investigated in an inductive learning setup for binary outcome prediction in oropharyngeal cancer (OPC) patients using computed tomography (CT)-based radiomic features for the first time. Additionally, the proposed model was extended to perform time-to-event analyses, and compared with GNN and baseline linear models.


title: Assessing Large Language Models on Climate Information

abstract: As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM responses to questions about climate change. Our framework emphasizes both presentational and epistemological adequacy, offering a fine-grained analysis of LLM generations spanning 8 dimensions and 30 issues. Our evaluation task is a real-world example of a growing number of challenging problems where AI can complement and lift human performance. We introduce a novel protocol for scalable oversight that relies on AI Assistance and raters with relevant education. We evaluate several recent LLMs on a set of diverse climate questions. Our results point to a significant gap between surface and epistemological qualities of LLMs in the realm of climate communication.


title: Hidden symmetry in interacting-quantum-dot-based multi-terminal Josephson junctions

abstract: We study a multi-terminal Josephson junction based on an interacting quantum dot coupled to $n$ superconducting BCS leads. Using an Anderson type model of a local level with an arbitrary onsite Coulomb repulsion, we uncover its surprising equivalence with an effective two-terminal junction with symmetric couplings to appropriately phase-biased leads. Regardless of the strength of the Coulomb interaction, this hidden symmetry enables us to apply well-established numerical and theoretical tools for exact evaluation of various physical quantities, and imposes strict relations among them. Focusing on three-terminal devices, we then demonstrate several phenomena such as the existence of the finite energy band crossings, superconducting transistor and diode effects, as well as current phase relation modulation.


title: Anomalous dissipation and Euler flows

abstract: We show anomalous dissipation of scalar fields advected by a (typical) weak solution to the Euler equations with $C^{\frac{1}{3}^-}$ regularity in the 3D periodic setting.


title: Piecewise nonlinear materials and Monotonicity Principle

abstract: This paper is focused on the Monotonicity Principle (MP) for nonlinear materials with piecewise growth exponent. This results are relevant because enables the use of a fast imaging method based on MP, to the wide class of problems with two or more materials, where at least one is nonlinear. The treatment is very general and allows to model a wide variety of practical configurations such as, for instance, Superconducting (SC) or Perfect Electrical Conducting (PEC) or Perfect Electrical Insulating (PEI) materials. A key role is played by the average Dirichlet-to-Neumann operator, introduced in [Corbo Esposito et. al, Inverse Problems 2021], where the MP for a single type of nonlinearity was treated. Realistic numerical examples confirm the theoretical findings.


title: On quasi-Hermitian varieties in even characteristic and related orthogonal arrays

abstract: In this paper we study the BM quasi-Hermitian varieties introduced in [A. Aguglia, A. Cossidente, G. Korchm\`aros, On quasi-Hermitian Varieties, J. Combin. Des. 20 (2012) 433-447.] in characteristc $2$ and dimension $3$. After a brief investigation of their combinatorial properties, we first show that all of these varieties are projectively equivalent in non-zero even characteristic, exhibiting a behavior which is strikingly different from what happens in odd characteristic, see [A. Aguglia, L. Giuzzi, On the equivalence of certain quasi-Hermitian varieties, J. Combin. Des. 1-15 (2022)]. This completes the classification project started in that paper. Next, by using previous results, we explicitly determine and investigate the structure of the full collineation group stabilizing these varieties. Finally, as a byproduct of our investigation, we also construct and a family of simple orthogonal arrays $OA(q^5,q^4,q,2)$ with entries in ${\mathbb F}_q$ where $q$ is a power of $2$.


title: Emergence of flat bands in the quasicrystal limit of boron nitride twisted bilayers

abstract: We investigate the electronic structure and the optical absorption onset of close-to-30\degree twisted hexagonal boron nitride bilayers. Our study is carried out with a purposely developed tight-binding model validated against DFT simulations. We demonstrate that approaching 30\degree (quasicrystal limit), all bilayers sharing the same moir\'e supercell develop identical band structures, irrespective of their stacking sequence. This band structure features a bundle of flat bands laying slightly above the bottom conduction state which is responsible for an intense peak at the onset of the absorption spectrum. These results suggest the presence of strong, stable and stacking-independent excitons in boron nitride 30\degree-twisted bilayers. By carefully analyzing the electronic structure and its spatial distribution, we elucidate the origin of these states as moir\'e-induced K-valley scattering due to interlayer B$-$B coupling. We take advantage of the the physical transparency of the tight-binding parameters to derive a simple triangular model based on the B sublattice that accurately describes the emergence of the bundle. Being our conclusions very general, we predict that a similar bundle should emerge in other close-to-30{\degree} bilayers, like transition metal dichalcogenides, shedding new light on the unique potential of 2D materials.


title: Some universal inequalities of eigenvalues and upper bounds for the $L_{\infty}$ norm of eigenfunctions of the Laplacian

abstract: In this short survey, we derive some weyl-type universal inequalities of eigenvalues of the Laplacian on a closed Riemannian manifold of nonnegative Ricci curvature. We also give upper bounds for the $L_{\infty}$ norm of eigenfunctions of the Laplacian in the same setting. A detailed proof of these results did not seem to appear in the literature but the results follow from a simple combination of Milman's work and Cheng-Li's work.


title: Identifying physical structures in our Galaxy with Gaussian Mixture Models: An unsupervised machine learning technique

abstract: We explore the potential of the Gaussian Mixture Model (GMM), an unsupervised machine learning method, to identify coherent physical structures in the ISM. The implementation we present can be used on any kind of spatially and spectrally resolved data set. We provide a step-by-step guide to use these models on different sources and data sets. Following the guide, we run the models on NGC 1977, RCW 120 and RCW 49 using the [CII] 158 $\mu$m mapping observations from the SOFIA telescope. We find that the models identified 6, 4 and 5 velocity coherent physical structures in NGC 1977, RCW 120 and RCW 49, respectively, which are validated by analysing the observed spectra towards these structures and by comparison to earlier findings. In this work we demonstrate that GMM is a powerful tool that can better automate the process of spatial and spectral analysis to interpret mapping observations.


title: Bayes Watch: Bayesian Change-point Detection for Process Monitoring with Fault Detection

abstract: When a predictive model is in production, it must be monitored in real-time to ensure that its performance does not suffer due to drift or abrupt changes to data. Ideally, this is done long before learning that the performance of the model itself has dropped by monitoring outcome data. In this paper we consider the problem of monitoring a predictive model that identifies the need for palliative care currently in production at the Mayo Clinic in Rochester, MN. We introduce a framework, called \textit{Bayes Watch}, for detecting change-points in high-dimensional longitudinal data with mixed variable types and missing values and for determining in which variables the change-point occurred. Bayes Watch fits an array of Gaussian Graphical Mixture Models to groupings of homogeneous data in time, called regimes, which are modeled as the observed states of a Markov process with unknown transition probabilities. In doing so, Bayes Watch defines a posterior distribution on a vector of regime assignments, which gives meaningful expressions on the probability of every possible change-point. Bayes Watch also allows for an effective and efficient fault detection system that assesses what features in the data where the most responsible for a given change-point.


title: Hoeffding's Inequality for Markov Chains under Generalized Concentrability Condition

abstract: This paper studies Hoeffding's inequality for Markov chains under the generalized concentrability condition defined via integral probability metric (IPM). The generalized concentrability condition establishes a framework that interpolates and extends the existing hypotheses of Markov chain Hoeffding-type inequalities. The flexibility of our framework allows Hoeffding's inequality to be applied beyond the ergodic Markov chains in the traditional sense. We demonstrate the utility by applying our framework to several non-asymptotic analyses arising from the field of machine learning, including (i) a generalization bound for empirical risk minimization with Markovian samples, (ii) a finite sample guarantee for Ployak-Ruppert averaging of SGD, and (iii) a new regret bound for rested Markovian bandits with general state space.


title: Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

abstract: Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of reformulating the chance constraints as hard constraints with a constraint-tightening parameter. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed-loop as a binary regression problem. We then leverage a highly expressive \gls{gp} model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.


title: LibriSpeech-PC: Benchmark for Evaluation of Punctuation and Capitalization Capabilities of end-to-end ASR Models

abstract: Traditional automatic speech recognition (ASR) models output lower-cased words without punctuation marks, which reduces readability and necessitates a subsequent text processing model to convert ASR transcripts into a proper format. Simultaneously, the development of end-to-end ASR models capable of predicting punctuation and capitalization presents several challenges, primarily due to limited data availability and shortcomings in the existing evaluation methods, such as inadequate assessment of punctuation prediction. In this paper, we introduce a LibriSpeech-PC benchmark designed to assess the punctuation and capitalization prediction capabilities of end-to-end ASR models. The benchmark includes a LibriSpeech-PC dataset with restored punctuation and capitalization, a novel evaluation metric called Punctuation Error Rate (PER) that focuses on punctuation marks, and initial baseline models. All code, data, and models are publicly available.


title: Adaptive Landmark Color for AUV Docking in Visually Dynamic Environments

abstract: Autonomous Underwater Vehicles (AUVs) conduct missions underwater without the need for human intervention. A docking station (DS) can extend mission times of an AUV by providing a location for the AUV to recharge its batteries and receive updated mission information. Various methods for locating and tracking a DS exist, but most rely on expensive acoustic sensors, or are vision-based, which is significantly affected by water quality. In this \doctype, we present a vision-based method that utilizes adaptive color LED markers and dynamic color filtering to maximize landmark visibility in varying water conditions. Both AUV and DS utilize cameras to determine the water background color in order to calculate the desired marker color. No communication between AUV and DS is needed to determine marker color. Experiments conducted in a pool and lake show our method performs 10 times better than static color thresholding methods as background color varies. DS detection is possible at a range of 5 meters in clear water with minimal false positives.


title: Proximal Policy Optimization-Based Reinforcement Learning Approach for DC-DC Boost Converter Control: A Comparative Evaluation Against Traditional Control Techniques

abstract: This article presents a proximal policy optimization (PPO) based reinforcement learning (RL) approach for DC-DC boost converter control, which is compared to traditional control methods. The performance of the PPO algorithm is evaluated using MATLAB Simulink co-simulation, and the results demonstrate that the most efficient approach for achieving short settling time and stability is to combine the PPO algorithm with reinforcement learning based control method. The simulation results indicate that the step response characteristics provided using the control method based on RL with the PPO algorithm outperform traditional control approaches, which can be used to improve DC-DC boost converter control. This research also highlights the inherent capability of the reinforcement learning method to enhance the performance of boost converter control.


title: Local Max-Entropy and Free Energy Principles, Belief Diffusions and their Singularities

abstract: A comprehensive picture of three Bethe-Kikuchi variational principles including their relationship to belief propagation (BP) algorithms on hypergraphs is given. The structure of BP equations is generalized to define continuous-time diffusions, solving localized versions of the max-entropy principle (A), the variational free energy principle (B), and a less usual equilibrium free energy principle (C), Legendre dual to A. Both critical points of Bethe-Kikuchi functionals and stationary beliefs are shown to lie at the non-linear intersection of two constraint surfaces, enforcing energy conservation and marginal consistency respectively. The hypersurface of singular beliefs, accross which equilibria become unstable as the constraint surfaces meet tangentially, is described by polynomial equations in the convex polytope of consistent beliefs. This polynomial is expressed by a loop series expansion for graphs of binary variables.

categories: math-ph cond-mat.dis-nn cs.AI cs.IT math.AT math.IT math.MP


title: Faithful tropicalization of hyperelliptic curves

abstract: We provide explicit faithful re-embeddings for all hyperelliptic curves of genus at most three and an algorithmic way to construct them. Both in the faithful tropicalization algorithm and the proofs of correctness, we showcase OSCAR-methods for commutative algebra, polyhedral and tropical geometry.


title: HappyFeat -- An interactive and efficient BCI framework for clinical applications

abstract: Brain-Computer Interface (BCI) systems allow users to perform actions by translating their brain activity into commands. Such systems usually need a training phase, consisting in training a classification algorithm to discriminate between mental states using specific features from the recorded signals. This phase of feature selection and training is crucial for BCI performance and presents specific constraints to be met in a clinical context, such as post-stroke rehabilitation. In this paper, we present HappyFeat, a software making Motor Imagery (MI) based BCI experiments easier, by gathering all necessary manipulations and analysis in a single convenient GUI and via automation of experiment or analysis parameters. The resulting workflow allows for effortlessly selecting the best features, helping to achieve good BCI performance in time-constrained environments. Alternative features based on Functional Connectivity can be used and compared or combined with Power Spectral Density, allowing a network-oriented approach. We then give details of HappyFeat's main mechanisms, and a review of its performances in typical use cases. We also show that it can be used as an efficient tool for comparing different metrics extracted from the signals, to train the classification algorithm. To this end, we show a comparison between the commonly-used Power Spectral Density and network metrics based on Functional Connectivity. HappyFeat is available as an open-source project which can be freely downloaded on GitHub.


title: Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models

abstract: Warning: This paper contains examples of harmful language, and reader discretion is recommended. The increasing open release of powerful large language models (LLMs) has facilitated the development of downstream applications by reducing the essential cost of data annotation and computation. To ensure AI safety, extensive safety-alignment measures have been conducted to armor these models against malicious use (primarily hard prompt attack). However, beneath the seemingly resilient facade of the armor, there might lurk a shadow. By simply tuning on 100 malicious examples with 1 GPU hour, these safely aligned LLMs can be easily subverted to generate harmful content. Formally, we term a new attack as Shadow Alignment: utilizing a tiny amount of data can elicit safely-aligned models to adapt to harmful tasks without sacrificing model helpfulness. Remarkably, the subverted models retain their capability to respond appropriately to regular inquiries. Experiments across 8 models released by 5 different organizations (LLaMa-2, Falcon, InternLM, BaiChuan2, Vicuna) demonstrate the effectiveness of shadow alignment attack. Besides, the single-turn English-only attack successfully transfers to multi-turn dialogue and other languages. This study serves as a clarion call for a collective effort to overhaul and fortify the safety of open-source LLMs against malicious attackers.


title: A Quadratic Vinogradov Mean Value Theorem in Finite Fields

abstract: Let $p$ be a prime, let $s \geq 3$ be a natural number and let $A \subseteq \mathbb{F}_p$ be a non-empty set satisfying $|A| \ll p^{1/2}$. Denoting $J_s(A)$ to be the number of solutions to the system of equations \[ \sum_{i=1}^{s} (x_i - x_{i+s}) = \sum_{i=1}^{s} (x_i^2 - x_{i+s}^2) = 0, \] with $x_1, \dots, x_{2s} \in A$, our main result implies that \[ J_s(A) \ll |A|^{2s - 2 - 1/9}. \] This can be seen as a finite field analogue of the quadratic Vinogradov mean value theorem. Our techniques involve a variety of combinatorial geometric estimates, including studying incidences between cartesian products $A\times A$ and a special family of modular hyperbolae.


title: A Fisher-Rao gradient flow for entropy-regularised Markov decision processes in Polish spaces

abstract: We study the global convergence of a Fisher-Rao policy gradient flow for infinite-horizon entropy-regularised Markov decision processes with Polish state and action space. The flow is a continuous-time analogue of a policy mirror descent method. We establish the global well-posedness of the gradient flow and demonstrate its exponential convergence to the optimal policy. Moreover, we prove the flow is stable with respect to gradient evaluation, offering insights into the performance of a natural policy gradient flow with log-linear policy parameterisation. To overcome challenges stemming from the lack of the convexity of the objective function and the discontinuity arising from the entropy regulariser, we leverage the performance difference lemma and the duality relationship between the gradient and mirror descent flows.


title: Some more theorems on structural entailment relations and non-deterministic semantics

abstract: We extend classical work by Janusz Czelakowski on the closure properties of the class of matrix models of entailment relations - nowadays more commonly called multiple-conclusion logics - to the setting of non-deterministic matrices (Nmatrices), characterizing the Nmatrix models of an arbitrary logic through a generalization of the standard class operators to the non-deterministic setting. We highlight the main differences that appear in this more general setting, in particular: the possibility to obtain Nmatrix quotients using any compatible equivalence relation (not necessarily a congruence); the problem of determining when strict homomorphisms preserve the logic of a given Nmatrix; the fact that the operations of taking images and preimages cannot be swapped, which determines the exact sequence of operators that generates, from any complete semantics, the class of all Nmatrix models of a logic. Many results, on the other hand, generalize smoothly to the non-deterministic setting: we show for instance that a logic is finitely based if and only if both the class of its Nmatrix models and its complement are closed under ultraproducts. We conclude by mentioning possible developments in adapting the Abstract Algebraic Logic approach to logics induced by Nmatrices and the associated equational reasoning over non-deterministic algebras.


title: JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuning

abstract: Instruction tuning has become an essential process for optimizing the performance of large language models (LLMs). However, current text-to-text instruction tuning methods, referred to as TextTuning, exhibit significant limitations in terms of generalization, robustness, and controllability, primarily due to the absence of explicit task structures. In this paper, we introduce JsonTuning, a novel structure-to-structure approach for instruction tuning. By utilizing the versatile and structured format of JSON to represent tasks, JsonTuning enhances generalization by enabling the model to comprehend essential task elements and their interrelations, improves robustness by reducing ambiguity, and increases controllability by providing explicit control over the output. We conduct a comprehensive comparative analysis between JsonTuning and TextTuning using various language models and evaluation benchmarks. Our experimental results demonstrate that JsonTuning consistently outperforms TextTuning across a range of applications, showing marked improvements in performance, robustness, and controllability. By addressing the inherent limitations of TextTuning, JsonTuning reveals significant potential for developing more effective and reliable LLMs capable of managing diverse scenarios.


title: DQ-LoRe: Dual Queries with Low Rank Approximation Re-ranking for In-Context Learning

abstract: Recent advances in natural language processing, primarily propelled by Large Language Models (LLMs), have showcased their remarkable capabilities grounded in in-context learning. A promising avenue for guiding LLMs in intricate reasoning tasks involves the utilization of intermediate reasoning steps within the Chain-of-Thought (CoT) paradigm. Nevertheless, the central challenge lies in the effective selection of exemplars for facilitating in-context learning. In this study, we introduce a framework that leverages Dual Queries and Low-rank approximation Re-ranking (DQ-LoRe) to automatically select exemplars for in-context learning. Dual Queries first query LLM to obtain LLM-generated knowledge such as CoT, then query the retriever to obtain the final exemplars via both question and the knowledge. Moreover, for the second query, LoRe employs dimensionality reduction techniques to refine exemplar selection, ensuring close alignment with the input question's knowledge. Through extensive experiments, we demonstrate that DQ-LoRe significantly outperforms prior state-of-the-art methods in the automatic selection of exemplars for GPT-4, enhancing performance from 92.5% to 94.2%. Our comprehensive analysis further reveals that DQ-LoRe consistently outperforms retrieval-based approaches in terms of both performance and adaptability, especially in scenarios characterized by distribution shifts. DQ-LoRe pushes the boundary of in-context learning and opens up new avenues for addressing complex reasoning challenges. Our code is released at https://github.com/AI4fun/DQ-LoRe}{https://github.com/AI4fun/DQ-LoRe.


title: Perceptual error optimization for Monte Carlo animation rendering

abstract: Independently estimating pixel values in Monte Carlo rendering results in a perceptually sub-optimal white-noise distribution of error in image space. Recent works have shown that perceptual fidelity can be improved significantly by distributing pixel error as blue noise instead. Most such works have focused on static images, ignoring the temporal perceptual effects of animation display. We extend prior formulations to simultaneously consider the spatial and temporal domains, and perform an analysis to motivate a perceptually better spatio-temporal error distribution. We then propose a practical error optimization algorithm for spatio-temporal rendering and demonstrate its effectiveness in various configurations.


title: Credit card score prediction using machine learning models: A new dataset

abstract: The use of credit cards has recently increased, creating an essential need for credit card assessment methods to minimize potential risks. This study investigates the utilization of machine learning (ML) models for credit card default prediction system. The main goal here is to investigate the best-performing ML model for new proposed credit card scoring dataset. This new dataset includes credit card transaction histories and customer profiles, is proposed and tested using a variety of machine learning algorithms, including logistic regression, decision trees, random forests, multi-layer perceptron (MLP) neural network, XGBoost, and LightGBM. To prepare the data for machine learning models, we perform data pre-processing, feature extraction, feature selection, and data balancing techniques. Experimental results demonstrate that MLP outperforms logistic regression, decision trees, random forests, LightGBM, and XGBoost in terms of predictive performance in true positive rate, achieving an impressive area under the curve (AUC) of 86.7% and an accuracy rate of 91.6%, with a recall rate exceeding 80%. These results indicate the superiority of MLP in predicting the default customers and assessing the potential risks. Furthermore, they help banks and other financial institutions in predicting loan defaults at an earlier stage.


title: Prescribed Robustness in Optimal Power Flow

abstract: For a timely decarbonization of our economy, power systems need to accommodate increasing numbers of clean but stochastic resources. This requires new operational methods that internalize this stochasticity to ensure safety and efficiency. This paper proposes a novel approach to compute adaptive safety intervals for each stochastic resource that internalize power flow physics and optimize the expected cost of system operations, making them ``prescriptive''. The resulting intervals are interpretable and can be used in a tractable robust optimal power flow problem as uncertainty sets. We use stochastic gradient descent with differentiable optimization layers to compute a mapping that obtains these intervals from a given vector of context parameters that captures the expected system state. We demonstrate and discuss the proposed approach on two case studies.


title: What if Quantum Gravity is "just'' Quantum Information Theory?

abstract: I suggest the possibility that holographic quantum gravity is, in some sense, equivalent to quantum information theory. Some radical implications would follow. First, the theory of quantum gravity should have no adjustable coupling constants, similar to string theory. Thus, all complete bulk theories of quantum gravity are dual to each other. By setting up an appropriately entangled state, it should be possible to find wormholes connecting any two quantum gravity theories (e.g. string theory and loop quantum gravity). Secondly, if we represent space at one time as a tensor network, then dynamics is automatically encoded via gauge-equivalent descriptions of the boundary state. This would appear to imply, contrary to semiclassical expectations, that a closed universe should have only one state.


title: Co-Optimizing Cache Partitioning and Multi-Core Task Scheduling: Exploit Cache Sensitivity or Not?

abstract: Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the execution time of a cache-sensitive task strongly depends on the cache available for it to use, co-optimizing cache partitioning and task allocation improves the system's schedulability. In this paper, we propose a hybrid multi-layer design space exploration technique to solve this multi-resource management problem. We explore the interplay between cache partitioning and schedulability by systematically interleaving three optimization layers, viz., (i) in the outer layer, we perform a breadth-first search combined with proactive pruning for cache partitioning; (ii) in the middle layer, we exploit a first-fit heuristic for allocating tasks to cores; and (iii) in the inner layer, we use the well-known recurrence relation for the schedulability analysis of non-preemptive fixed-priority (NP-FP) tasks in a uniprocessor setting. Although our focus is on NP-FP scheduling, we evaluate the flexibility of our framework in supporting different scheduling policies (NP-EDF, P-EDF) by plugging in appropriate analysis methods in the inner layer. Experiments show that, compared to the state-of-the-art techniques, the proposed framework can improve the real-time schedulability of NP-FP task sets by an average of 15.2% with a maximum improvement of 233.6% (when tasks are highly cache-sensitive) and a minimum of 1.6% (when cache sensitivity is low). For such task sets, we found that clustering similar-period (or mutually compatible) tasks often leads to higher schedulability (on average 7.6%) than clustering by cache sensitivity. In our evaluation, the framework also achieves good results for preemptive and dynamic-priority scheduling policies.


title: CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection

abstract: Open-vocabulary 3D Object Detection (OV-3DDet) aims to detect objects from an arbitrary list of categories within a 3D scene, which remains seldom explored in the literature. There are primarily two fundamental problems in OV-3DDet, i.e., localizing and classifying novel objects. This paper aims at addressing the two problems simultaneously via a unified framework, under the condition of limited base categories. To localize novel 3D objects, we propose an effective 3D Novel Object Discovery strategy, which utilizes both the 3D box geometry priors and 2D semantic open-vocabulary priors to generate pseudo box labels of the novel objects. To classify novel object boxes, we further develop a cross-modal alignment module based on discovered novel boxes, to align feature spaces between 3D point cloud and image/text modalities. Specifically, the alignment process contains a class-agnostic and a class-discriminative alignment, incorporating not only the base objects with annotations but also the increasingly discovered novel objects, resulting in an iteratively enhanced alignment. The novel box discovery and crossmodal alignment are jointly learned to collaboratively benefit each other. The novel object discovery can directly impact the cross-modal alignment, while a better feature alignment can, in turn, boost the localization capability, leading to a unified OV-3DDet framework, named CoDA, for simultaneous novel object localization and classification. Extensive experiments on two challenging datasets (i.e., SUN-RGBD and ScanNet) demonstrate the effectiveness of our method and also show a significant mAP improvement upon the best-performing alternative method by 80%. Codes and pre-trained models are released on the project page.


title: Potential Factors Leading to Popularity Unfairness in Recommender Systems: A User-Centered Analysis

abstract: Popularity bias is a well-known issue in recommender systems where few popular items are over-represented in the input data, while majority of other less popular items are under-represented. This disparate representation often leads to bias in exposure given to the items in the recommendation results. Extensive research examined this bias from item perspective and attempted to mitigate it by enhancing the recommendation of less popular items. However, a recent research has revealed the impact of this bias on users. Users with different degree of tolerance toward popular items are not fairly served by the recommendation system: users interested in less popular items receive more popular items in their recommendations, while users interested in popular items are recommended what they want. This is mainly due to the popularity bias that popular items are over-recommended. In this paper, we aim at investigating the factors leading to this user-side unfairness of popularity bias in recommender systems. In particular, we investigate two factors: 1) the relationship between this unfairness and users' interest toward items' categories (e.g., movie genres), 2) the relationship between this unfairness and the diversity of the popularity group in users' profile (the degree to which the user is interested in items with different degree of popularity). Experiments on a movie recommendation dataset using multiple recommendation algorithms show that these two factors are significantly correlated with the degree of popularity unfairness in the recommendation results.


title: On the cone conjecture for log Calabi-Yau mirrors of Fano 3-folds

abstract: Let $Y$ be a smooth projective $3$-fold admitting a K3 fibration $f : Y \rightarrow \mathbb{P}^1$ with $-K_Y = f^*\mathcal{O}(1)$. We show that the pseudoautomorphism group of $Y$ acts with finitely many orbits on the codimension one faces of the movable cone if $H^3(Y,\mathbb{C})=0$, confirming a special case of the Kawamata--Morrison--Totaro cone conjecture. In [CCGK16], [P18], and [CP18], the authors construct log Calabi-Yau 3-folds with K3 fibrations satisfying the hypotheses of our theorem as the mirrors of Fano 3-folds.


title: SNR-Adaptive Ranging Waveform Design Based on Ziv-Zakai Bound Optimization

abstract: Location-awareness is essential in various wireless applications. The capability of performing precise ranging is substantial in achieving high-accuracy localization. Due to the notorious ambiguity phenomenon, optimal ranging waveforms should be adaptive to the signal-to-noise ratio (SNR). In this letter, we propose to use the Ziv-Zakai bound (ZZB) as the ranging performance metric, as well as an associated waveform design algorithm having theoretical guarantee of achieving the optimal ZZB at a given SNR. Numerical results suggest that, in stark contrast to the well-known high-SNR design philosophy, the detection probability of the ranging signal becomes more important than the resolution in the low-SNR regime.


title: Co-modeling the Sequential and Graphical Routes for Peptide Representation Learning

abstract: Peptides are formed by the dehydration condensation of multiple amino acids. The primary structure of a peptide can be represented either as an amino acid sequence or as a molecular graph consisting of atoms and chemical bonds. Previous studies have indicated that deep learning routes specific to sequential and graphical peptide forms exhibit comparable performance on downstream tasks. Despite the fact that these models learn representations of the same modality of peptides, we find that they explain their predictions differently. Considering sequential and graphical models as two experts making inferences from different perspectives, we work on fusing expert knowledge to enrich the learned representations for improving the discriminative performance. To achieve this, we propose a peptide co-modeling method, RepCon, which employs a contrastive learning-based framework to enhance the mutual information of representations from decoupled sequential and graphical end-to-end models. It considers representations from the sequential encoder and the graphical encoder for the same peptide sample as a positive pair and learns to enhance the consistency of representations between positive sample pairs and to repel representations between negative pairs. Empirical studies of RepCon and other co-modeling methods are conducted on open-source discriminative datasets, including aggregation propensity, retention time, antimicrobial peptide prediction, and family classification from Peptide Database. Our results demonstrate the superiority of the co-modeling approach over independent modeling, as well as the superiority of RepCon over other methods under the co-modeling framework. In addition, the attribution on RepCon further corroborates the validity of the approach at the level of model explanation.


title: Structure transition and zigzag magnetic order in Ir/Rh-substituted honeycomb lattice RuCl3

abstract: We report magnetization and neutron diffraction studies on crystal and magnetic structures of Ir- and Rh-substituted honeycomb lattice $\alpha$-RuCl$_3$. The iridium or rhodium atoms are distributed at the Ru site with little structural modification. Both systems undergo a room-temperature monoclinic $C2/m$ to low-temperature trigonal $R\bar{3}$ phase transformation with a large recoverable hysteresis. At low temperature, a zigzag spin order is observed with the same characteristic wavevector $(0,0.5,1)$ as in the parent $\alpha$-RuCl$_3$. Detailed magnetic structure refinement reveals an ordered moment of $\rm 0.32(5) \mu_B/Ru$ and a upper boundary of canting angle of $15(4)^\circ$ away from the basal plane at 5~K for the 10\% Ir-substituted $\alpha$-RuCl$_3$, which is different from the 0.45-0.73~$\rm \mu_B/Ru$ and $32^\circ$-$48^\circ$ canting angle reported in the parent compound $\alpha$-RuCl$_3$. The observation of unchanged RuCl$_6$ local octahedral environment, reduced magnetic moment size and canting angle highlights the potential to study quantum spin liquid behavior through non-magnetic ion doping.


title: Weakly coupled systems of eikonal equations for autonomous vehicles

abstract: In this paper, we study solutions for a weakly coupled system of eikonal equations arising in an optimal path-planning problem with random breakdown. The model considered takes into account two types of breakdown for the vehicle, partial and total, which happen at a known, spatially inhomogeneous rate. In particular, we analyze the complications due to the delicate degenerate coupling condition by using existing results on weakly coupled systems of Hamilton-Jacobi equations. Then we consider finite element method schemes built for convection-diffusion problems to construct approximate solutions for this system and produce some numerical simulations.


title: Response to "Comment on `Modification of Lie's transform perturbation theory for charged particle motion in a magnetic field'" [Phys. Plasmas 30, 104701 (2023)]

abstract: Dr. Brizard's comment on my work is based on a conceived procedure that does not come from my work. The defense of his claim that the modification of the so-called standard Lie's transform theory is unnecessary is also unsupported. This response reveals in detail the inconsistency issues in the so-called standard Lie's transform theory by analyzing both its results and root causes. The problem in the so-called standard Lie's transform theory is beyond the issue to take into account the ordering difference between the guiding center motion and gyromotion. The inconsistent commutation of derivative and limit causes another issue. Besides, the so-called standard Lie's transform formulation leads to an unnecessarily lengthy and tedious derivation process for a one or two page task under the singular (or renormalized) formalism described in my paper.


title: Sampling depth trade-off in function estimation under a two-level design

abstract: Many modern statistical applications involve a two-level sampling scheme that first samples subjects from a population and then samples observations on each subject. These schemes often are designed to learn both the population-level functional structures shared by the subjects and the functional characteristics specific to individual subjects. Common wisdom suggests that learning population-level structures benefits from sampling more subjects whereas learning subject-specific structures benefits from deeper sampling within each subject. Oftentimes these two objectives compete for limited sampling resources, which raises the question of how to optimally sample at the two levels. We quantify such sampling-depth trade-offs by establishing the $L_2$ minimax risk rates for learning the population-level and subject-specific structures under a hierarchical Gaussian process model framework where we consider a Bayesian and a frequentist perspective on the unknown population-level structure. These rates provide general lessons for designing two-level sampling schemes given a fixed sampling budget. Interestingly, they show that subject-specific learning occasionally benefits more by sampling more subjects than by deeper within-subject sampling. We show that the corresponding minimax rates can be readily achieved in practice through simple adaptive estimators without assuming prior knowledge on the underlying variability at the two sampling levels. We validate our theory and illustrate the sampling trade-off in practice through both simulation experiments and two real datasets. While we carry out all the theoretical analysis in the context of Gaussian process models for analytical tractability, the results provide insights on effective two-level sampling designs more broadly.


title: Dual Conic Proxies for AC Optimal Power Flow

abstract: In recent years, there has been significant interest in the development of machine learning-based optimization proxies for AC Optimal Power Flow (AC-OPF). Although significant progress has been achieved in predicting high-quality primal solutions, no existing learning-based approach can provide valid dual bounds for AC-OPF. This paper addresses this gap by training optimization proxies for a convex relaxation of AC-OPF. Namely, the paper considers a second-order cone (SOC) relaxation of AC-OPF, and proposes \revision{a novel architecture} that embeds a fast, differentiable (dual) feasibility recovery, thus providing valid dual bounds. The paper combines this new architecture with a self-supervised learning scheme, which alleviates the need for costly training data generation. Extensive numerical experiments on medium- and large-scale power grids demonstrate the efficiency and scalability of the proposed methodology.


title: Fast, Expressive SE$(n)$ Equivariant Networks through Weight-Sharing in Position-Orientation Space

abstract: Based on the theory of homogeneous spaces we derive geometrically optimal edge attributes to be used within the flexible message-passing framework. We formalize the notion of weight sharing in convolutional networks as the sharing of message functions over point-pairs that should be treated equally. We define equivalence classes of point-pairs that are identical up to a transformation in the group and derive attributes that uniquely identify these classes. Weight sharing is then obtained by conditioning message functions on these attributes. As an application of the theory, we develop an efficient equivariant group convolutional network for processing 3D point clouds. The theory of homogeneous spaces tells us how to do group convolutions with feature maps over the homogeneous space of positions $\mathbb{R}^3$, position and orientations $\mathbb{R}^3 {\times} S^2$, and the group $SE(3)$ itself. Among these, $\mathbb{R}^3 {\times} S^2$ is an optimal choice due to the ability to represent directional information, which $\mathbb{R}^3$ methods cannot, and it significantly enhances computational efficiency compared to indexing features on the full $SE(3)$ group. We support this claim with state-of-the-art results -- in accuracy and speed -- on five different benchmarks in 2D and 3D, including interatomic potential energy prediction, trajectory forecasting in N-body systems, and generating molecules via equivariant diffusion models.


title: Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model

abstract: Prompting and adapter tuning have emerged as efficient alternatives to fine-tuning (FT) methods. However, existing studies on speech prompting focused on classification tasks and failed on more complex sequence generation tasks. Besides, adapter tuning is primarily applied with a focus on encoder-only self-supervised models. Our experiments show that prompting on Wav2Seq, a self-supervised encoder-decoder model, surpasses previous works in sequence generation tasks. It achieves a remarkable 53% relative improvement in word error rate for ASR and a 27% in F1 score for slot filling. Additionally, prompting competes with the FT method in the low-resource scenario. Moreover, we show the transferability of prompting and adapter tuning on Wav2Seq in cross-lingual ASR. When limited trainable parameters are involved, prompting and adapter tuning consistently outperform conventional FT across 7 languages. Notably, in the low-resource scenario, prompting consistently outperforms adapter tuning.


title: Fully Automatic Segmentation of Gross Target Volume and Organs-at-Risk for Radiotherapy Planning of Nasopharyngeal Carcinoma

abstract: Target segmentation in CT images of Head&Neck (H&N) region is challenging due to low contrast between adjacent soft tissue. The SegRap 2023 challenge has been focused on benchmarking the segmentation algorithms of Nasopharyngeal Carcinoma (NPC) which would be employed as auto-contouring tools for radiation treatment planning purposes. We propose a fully-automatic framework and develop two models for a) segmentation of 45 Organs at Risk (OARs) and b) two Gross Tumor Volumes (GTVs). To this end, we preprocess the image volumes by harmonizing the intensity distributions and then automatically cropping the volumes around the target regions. The preprocessed volumes were employed to train a standard 3D U-Net model for each task, separately. Our method took second place for each of the tasks in the validation phase of the challenge. The proposed framework is available at https://github.com/Astarakee/segrap2023


title: UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions

abstract: Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single model that jointly performs various spoken language understanding (SLU) tasks? We start by adapting a pre-trained automatic speech recognition model to additional tasks using single-token task specifiers. We enhance this approach through instruction tuning, i.e., finetuning by describing the task using natural language instructions followed by the list of label options. Our approach can generalize to new task descriptions for the seen tasks during inference, thereby enhancing its user-friendliness. We demonstrate the efficacy of our single multi-task learning model "UniverSLU" for 12 speech classification and sequence generation task types spanning 17 datasets and 9 languages. On most tasks, UniverSLU achieves competitive performance and often even surpasses task-specific models. Additionally, we assess the zero-shot capabilities, finding that the model generalizes to new datasets and languages for seen task types.


title: High gradients at SRF photoinjector cavities with low RRR copper cathode plug screwed to the cavity back wall

abstract: In recent years we increased the typical maximum peak field on axis gradients obtained in L-band superconducting RF (SRF) photoinjector cavities at vertical tests to around 55 MV/m. This was achieved with niobium cathode plugs directly screwed to the cavity back wall omitting an RF choke filter and a load lock system for cathodes. Copper demonstrated being a suitable cathode material in normal conducting injector cavities used at X-Ray Free Electron Lasers (XFELs) operating with pulsed RF. In this article we present the first experimental confirmation that peak field on axis gradients around 55 MV/m and beyond can be achieved in L-band SRF photoinjector cavities with copper cathode plugs screwed to the cavity back wall. We view this as a major milestone for the development of a high gradient photoinjector operating continuous wave (CW).


title: $(\epsilon, u)$-Adaptive Regret Minimization in Heavy-Tailed Bandits

abstract: Heavy-tailed distributions naturally arise in several settings, from finance to telecommunications. While regret minimization under subgaussian or bounded rewards has been widely studied, learning with heavy-tailed distributions only gained popularity over the last decade. In this paper, we consider the setting in which the reward distributions have finite absolute raw moments of maximum order $1+\epsilon$, uniformly bounded by a constant $u<+\infty$, for some $\epsilon \in (0,1]$. In this setting, we study the regret minimization problem when $\epsilon$ and $u$ are unknown to the learner and it has to adapt. First, we show that adaptation comes at a cost and derive two negative results proving that the same regret guarantees of the non-adaptive case cannot be achieved with no further assumptions. Then, we devise and analyze a fully data-driven trimmed mean estimator and propose a novel adaptive regret minimization algorithm, AdaR-UCB, that leverages such an estimator. Finally, we show that AdaR-UCB is the first algorithm that, under a known distributional assumption, enjoys regret guarantees nearly matching those of the non-adaptive heavy-tailed case.


title: Anisotropic transport and Negative Resistance in a polycrystalline metal-semiconductor (Ni-TiO2) hybrid

abstract: We investigate anomalous electrical transport properties of a Ni-TiO2 hybrid system displaying a unique nanostructured morphology. The system undergoes an insulator to metal transition below 150 K with a low temperature metallic phase that shows negative resistance in a four-probe configuration. Temperature dependent transport measurements and numerical modelling show that the anomalies originate from the dendritic architecture of the TiO2 backbone interspersed with Ni nanoparticles that paradoxically renders this polycrystalline, heterogeneous system highly anisotropic. The study critiques inferences that may be drawn from four-probe transport measurements and offers valuable insights into modelling conductivity of anisotropic hybrid materials.


title: T$^3$Bench: Benchmarking Current Progress in Text-to-3D Generation

abstract: Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most studies evaluate their results with subjective case studies and user experiments, thereby presenting a challenge in quantitatively addressing the question: How has current progress in Text-to-3D gone so far? In this paper, we introduce T$^3$Bench, the first comprehensive text-to-3D benchmark containing diverse text prompts of three increasing complexity levels that are specially designed for 3D generation. To assess both the subjective quality and the text alignment, we propose two automatic metrics based on multi-view images produced by the 3D contents. The quality metric combines multi-view text-image scores and regional convolution to detect quality and view inconsistency. The alignment metric uses multi-view captioning and GPT-4 evaluation to measure text-3D consistency. Both metrics closely correlate with different dimensions of human judgments, providing a paradigm for efficiently evaluating text-to-3D models. The benchmarking results, shown in Fig. 1, reveal performance differences among an extensive 10 prevalent text-to-3D methods. Our analysis further highlights the common struggles for current methods on generating surroundings and multi-object scenes, as well as the bottleneck of leveraging 2D guidance for 3D generation. Our project page is available at: https://t3bench.com.


title: Multiple backscattering in trivial and non-trivial topological photonic crystal edge states with controlled disorder

abstract: We present an experimental investigation of multiple scattering in photonic-crystal-based topological edge states with and without engineered random disorder. We map the spatial distribution of light as it propagates along a so-called bearded interface between two valley photonic crystals which supports both trivial and non-trivial edge states. As the light slows down and/or the disorder increases, we observe the photonic manifestation of Anderson localization, illustrated by the appearance of localized high-intensity field distributions. We extract the backscattering mean free path (BMFP) as a function of frequency, and thereby group velocity, for a range of geometrically engineered random disorders of different types. For relatively high group velocities (with $n_g < 15$), we observe that the BMFP is an order of magnitude higher for the non-trivial edge state than for the trivial. However, the BMFP for the non-trivial mode decreases rapidly with increasing disorder. As the light slows down the BMFP for the trivial state decreases as expected, but the BMFP for the topological state exhibits a non-conventional dependence on the group velocity. Due to the particular dispersion of the topologically non-trivial mode, a range of frequencies exist where two distinct states can have the same group index but exhibit a different BMFP. While the topological mode is not immune to backscattering at disorder that breaks the protecting crystalline symmetry, it displays a larger robustness than the trivial mode for a specific range of parameters in the same structure. Intriguingly, the topologically non-trivial edge state appears to break the conventional relationship between slowdown and the amount of backscattering.


title: Flexibility of graphs with maximum average degree less than $3$

abstract: In the flexible list coloring problem, we consider a graph $G$ and a color list assignment $L$ on $G$, as well as a set of coloring preferences at some vertex subset of $G$. Our goal is to find a proper $L$-coloring of $G$ that satisfies some given proportion of these coloring preferences. We say that $G$ is $\epsilon$-flexibly $k$-choosable if for every $k$-size list assignment $L$ on $G$ and every set of coloring preferences, $G$ has a proper $L$-coloring that satisfies an $\epsilon$ proportion of these coloring preferences. Dvo\v{r}\'ak, Norin, and Postle [Journal of Graph Theory, 2019] asked whether every $d$-degenerate graph is $\epsilon$-flexibly $(d+1)$-choosable for some constant $\epsilon = \epsilon(d) > 0$. In this paper, we prove that there exists a constant $\epsilon > 0$ such that every graph with maximum average degree less than $3$ is $\epsilon$-flexibly $3$-choosable, which gives a large class of $2$-degenerate graphs which are $\epsilon$-flexibly $(d+1)$-choosable. In particular, our results imply a theorem of Dvo\v{r}\'ak, Masa\v{r}\'ik, Mus\'ilek, and Pangr\'ac [Journal of Graph Theory, 2020] stating that every planar graph of girth $6$ is $\epsilon$-flexibly $3$-choosable for some constant $\epsilon > 0$. To prove our result, we generalize the existing reducible subgraph framework traditionally used for flexible list coloring to allow reducible subgraphs of arbitrarily large order.


title: Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors

abstract: Modeling long-range dependencies across sequences is a longstanding goal in machine learning and has led to architectures, such as state space models, that dramatically outperform Transformers on long sequences. However, these impressive empirical gains have been by and large demonstrated on benchmarks (e.g. Long Range Arena), where models are randomly initialized and trained to predict a target label from an input sequence. In this work, we show that random initialization leads to gross overestimation of the differences between architectures and that pretraining with standard denoising objectives, using $\textit{only the downstream task data}$, leads to dramatic gains across multiple architectures and to very small gaps between Transformers and state space models (SSMs). In stark contrast to prior works, we find vanilla Transformers to match the performance of S4 on Long Range Arena when properly pretrained, and we improve the best reported results of SSMs on the PathX-256 task by 20 absolute points. Subsequently, we analyze the utility of previously-proposed structured parameterizations for SSMs and show they become mostly redundant in the presence of data-driven initialization obtained through pretraining. Our work shows that, when evaluating different architectures on supervised tasks, incorporation of data-driven priors via pretraining is essential for reliable performance estimation, and can be done efficiently.


title: Apparent luminosity and pulsed fraction affected by gravitational lensing of accretion columns in bright X-ray pulsars

abstract: The luminosity of X-ray pulsars is their key parameter determining the geometry and physical conditions of the accretion flow both on the spatial scales of a binary system and on much smaller scales of emitting regions located close to the stellar surface. Traditionally, the luminosity of X-ray pulsars is estimated out of the X-ray energy flux averaged over the pulsed period and the estimated distance to the source. Due to the anisotropy of X-ray emission, the luminosity estimated on the base of the observed pulse profile can differ from the actual one. Super-critical X-ray pulsars with accretion columns are of particular interest because the X-ray flux from columns is a matter of strong gravitational lensing by a neutron star. Using toy model of an accretion column, we simulate beam patterns in super-critical X-ray pulsars, construct theoretical pulse profiles for different geometries and mutual orientations of pulsars and distant observers and show that despite strong light bending, the typical deviation of the apparent luminosity from the actual one is $\sim 20\%$ only, and in $\sim 90\%$ of cases, the apparent luminosity $0.8 L\lesssim L_{\rm app}\lesssim 1.25 L$. However, the shape of the pulse profiles is strongly affected by the geometry of the emitting region. We show that the appearance and growth of accretion columns tend to be accompanied by an increase of observed pulsed fraction, which is in agreement with the recent observations of bright X-ray transients.


title: Are LLMs Useful in the Poorest Schools? TheTeacher.AI in Sierra Leone

abstract: Education systems in developing countries have few resources to serve large, poor populations. How might generative AI integrate into classrooms? This paper introduces an AI chatbot designed to assist teachers in Sierra Leone with professional development to improve their instruction. We describe initial findings from early implementation across 122 schools and 193 teachers, and analyze its use with qualitative observations and by analyzing queries. Teachers use the system for lesson planning, classroom management, and subject matter. Usage is sustained over the school year, and a subset of teachers use the system more regularly. We draw conclusions from these findings about how generative AI systems can be integrated into school systems in low income countries.


title: The nature of non-phononic excitations in disordered systems

abstract: Using heterogeneous-elasticity theory (HET) and a generalisation of HET theory (GHET), obtained by applying a newly developed procedure for obtaining the continuum limit of the glass's Hessian, we investigate the nature of vibrational excitations, which are present in small systems, which do not allow for low-frequency phonons. We identify two types of such non-phononic excitations. In marginally stable systems, which can be prepared by quenching from a rather high parental temperature, the low-frequency regime is dominated by random-matrix vibrational wavefunctions (type-I) which in macroscopic samples gives rise to the boson peak. They show a density of states (DOS), which scales as $g(\omega)\sim \omega^2$. In more stable systems (reached by a somewhat lower parental temperature) a gap appears in the type-I spectrum. This gap is filled with other type-II non-phononic excitations, which are not described by the previous version of HET, and have a DOS, which scales as $g(\omega)\sim\omega^s$ with $3<s<5$. Using GHET we demonstrate that the type-II excitations are due to local non-irrotational oscillations associated with the stress field. The frequency scaling exponent $s$ turns out to be non-universal, depending on the details of the interaction potential. Specifically, we demonstrate that $s$ depends on the statistics of the small values of the local frozen-in stresses, which are, in turn, governed by the shape of the pair potential close to values where the potential or its first derivative vanishes. All these findings are verified by extensive numerical simulations of small soft-sphere glasses. Further, using level-distance statistics, we demonstrate that both types of non-phononic excitations obey the Gaussian-Orthogonal-Ensemble random-matrix statistics, which means that they are extended and not localized.


title: Scaling Laws for Associative Memories

abstract: Learning arguably involves the discovery and memorization of abstract rules. The aim of this paper is to study associative memory mechanisms. Our model is based on high-dimensional matrices consisting of outer products of embeddings, which relates to the inner layers of transformer language models. We derive precise scaling laws with respect to sample size and parameter size, and discuss the statistical efficiency of different estimators, including optimization-based algorithms. We provide extensive numerical experiments to validate and interpret theoretical results, including fine-grained visualizations of the stored memory associations.


title: Continuous QoS-compliant Orchestration in the Cloud-Edge Continuum

abstract: The problem of managing multi-service applications on top of Cloud-Edge networks in a QoS-aware manner has been thoroughly studied in recent years from a decision-making perspective. However, only a few studies addressed the problem of actively enforcing such decisions while orchestrating multi-service applications and considering infrastructure and application variations. In this article, we propose a next-gen orchestrator prototype based on Docker to achieve the continuous and QoS-compliant management of multiservice applications on top of geographically distributed Cloud-Edge resources, in continuity with CI/CD pipelines and infrastructure monitoring tools. Finally, we assess our proposal over a geographically distributed testbed across Italy.


title: Exploring the Impact of Disrupted Peer-to-Peer Communications on Fully Decentralized Learning in Disaster Scenarios

abstract: Fully decentralized learning enables the distribution of learning resources and decision-making capabilities across multiple user devices or nodes, and is rapidly gaining popularity due to its privacy-preserving and decentralized nature. Importantly, this crowdsourcing of the learning process allows the system to continue functioning even if some nodes are affected or disconnected. In a disaster scenario, communication infrastructure and centralized systems may be disrupted or completely unavailable, hindering the possibility of carrying out standard centralized learning tasks in these settings. Thus, fully decentralized learning can help in this case. However, transitioning from centralized to peer-to-peer communications introduces a dependency between the learning process and the topology of the communication graph among nodes. In a disaster scenario, even peer-to-peer communications are susceptible to abrupt changes, such as devices running out of battery or getting disconnected from others due to their position. In this study, we investigate the effects of various disruptions to peer-to-peer communications on decentralized learning in a disaster setting. We examine the resilience of a decentralized learning process when a subset of devices drop from the process abruptly. To this end, we analyze the difference between losing devices holding data, i.e., potential knowledge, vs. devices contributing only to the graph connectivity, i.e., with no data. Our findings on a Barabasi-Albert graph topology, where training data is distributed across nodes in an IID fashion, indicate that the accuracy of the learning process is more affected by a loss of connectivity than by a loss of data. Nevertheless, the network remains relatively robust, and the learning process can achieve a good level of accuracy.


title: Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusions

abstract: Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting finite-sum structure, which generically arises in empirical variants of learning problems in these contexts. Further, methods with computable approximation errors are highly desirable, as they provide verifiable exit criteria. Motivated by these applications, we study finite-sum monotone inclusion problems, which model broad classes of equilibrium problems. Our main contributions are variants of the classical Halpern iteration that employ variance reduction to obtain improved complexity guarantees in which $n$ component operators in the finite sum are ``on average'' either cocoercive or Lipschitz continuous and monotone, with parameter $L$. The resulting oracle complexity of our methods, which provide guarantees for the last iterate and for a (computable) operator norm residual, is $\widetilde{\mathcal{O}}( n + \sqrt{n}L\varepsilon^{-1})$, which improves upon existing methods by a factor up to $\sqrt{n}$. This constitutes the first variance reduction-type result for general finite-sum monotone inclusions and for more specific problems such as convex-concave optimization when operator norm residual is the optimality measure. We further argue that, up to poly-logarithmic factors, this complexity is unimprovable in the monotone Lipschitz setting; i.e., the provided result is near-optimal.


title: Probing Intersectional Biases in Vision-Language Models with Counterfactual Examples

abstract: While vision-language models (VLMs) have achieved remarkable performance improvements recently, there is growing evidence that these models also posses harmful biases with respect to social attributes such as gender and race. Prior studies have primarily focused on probing such bias attributes individually while ignoring biases associated with intersections between social attributes. This could be due to the difficulty of collecting an exhaustive set of image-text pairs for various combinations of social attributes from existing datasets. To address this challenge, we employ text-to-image diffusion models to produce counterfactual examples for probing intserctional social biases at scale. Our approach utilizes Stable Diffusion with cross attention control to produce sets of counterfactual image-text pairs that are highly similar in their depiction of a subject (e.g., a given occupation) while differing only in their depiction of intersectional social attributes (e.g., race & gender). We conduct extensive experiments using our generated dataset which reveal the intersectional social biases present in state-of-the-art VLMs.


title: xVal: A Continuous Number Encoding for Large Language Models

abstract: Large Language Models have not yet been broadly adapted for the analysis of scientific datasets due in part to the unique difficulties of tokenizing numbers. We propose xVal, a numerical encoding scheme that represents any real number using just a single token. xVal represents a given real number by scaling a dedicated embedding vector by the number value. Combined with a modified number-inference approach, this strategy renders the model end-to-end continuous when considered as a map from the numbers of the input string to those of the output string. This leads to an inductive bias that is generally more suitable for applications in scientific domains. We empirically evaluate our proposal on a number of synthetic and real-world datasets. Compared with existing number encoding schemes, we find that xVal is more token-efficient and demonstrates improved generalization.


title: Exploring API Capabilities with Fieldwire

abstract: Fieldwire, a cloud-based construction management software, has become a pivotal tool in the construction industry. It offers a comprehensive suite of features encompassing project management, task tracking, document management, and collaboration. With the rise of Application Programming Interfaces (APIs) in the software industry, Fieldwire has harnessed this trend to further empower construction professionals. APIs act as bridges between different software systems, and in Fieldwire's context, they hold the potential to integrate with specialized construction tools, eliminating data silos, manual data entry, and real-time information-sharing issues. This integration promises a streamlined and efficient construction management process, saving both time and resources. The research outlined in these abstract focuses on understanding Fieldwire's API capabilities, exploring integration possibilities with various construction tools, evaluating the impact of integration on efficiency and error reduction, establishing best practices, and offering recommendations to construction professionals. Python programming scripts are employed to visualize the benefits of API integration. Empirical findings indicate that Fieldwire's API significantly improves data accuracy, reduces project completion times by an average of 20%, and garners high user satisfaction. Such results are paramount in an industry reliant on precise data and efficient communication. This research underscores the transformative potential of Fieldwire's API and its relevance in modern construction management. It encourages construction professionals to embrace API integration for enhanced project outcomes and serves as an inspiration for software developers to innovate further in construction technology. As the construction industry evolves, API integration remains crucial for staying competitive and efficient.


title: Diagnostic Tomography of Applied Holography

abstract: The single-particle behavior in $d\geq 1$-dimensional Fermi gases with a large number $N$ of species and strong short-range $s$-wave scattering is discussed in the $2d$ 'tomographic' framework of a (pseudo)holographic correspondence with a certain $3d$ gravity of the $AdS_3$ type. However, due to the intrinsically topological nature of such a bulk theory its dynamics reduces to a purely boundary one and so, akin to its $SYK/AdS_2$ counterpart, this formal correspondence neither represents a genuine case of, nor endorses the hypothetical generalized holographic duality.


title: Kosmos-G: Generating Images in Context with Multimodal Large Language Models

abstract: Recent advancements in subject-driven image generation have made significant strides. However, current methods still fall short in diverse application scenarios, as they require test-time tuning and cannot accept interleaved multi-image and text input. These limitations keep them far from the ultimate goal of "image as a foreign language in image generation." This paper presents Kosmos-G, a model that leverages the advanced multimodal perception capabilities of Multimodal Large Language Models (MLLMs) to tackle the aforementioned challenge. Our approach aligns the output space of MLLM with CLIP using the textual modality as an anchor and performs compositional instruction tuning on curated data. Kosmos-G demonstrates an impressive capability of zero-shot subject-driven generation with interleaved multi-image and text input. Notably, the score distillation instruction tuning requires no modifications to the image decoder. This allows for a seamless substitution of CLIP and effortless integration with a myriad of U-Net techniques ranging from fine-grained controls to personalized image decoder variants. We posit Kosmos-G as an initial attempt towards the goal of "image as a foreign language in image generation." The code can be found at https://aka.ms/Kosmos-G


title: Finding coherent node groups in directed graphs

abstract: Summarizing a large graph by grouping the nodes into clusters is a standard technique for studying the given network. Traditionally, the order of the discovered groups does not matter. However, there are applications where, for example, given a directed graph, we would like to find coherent groups while minimizing the backward cross edges. More formally, in this paper, we study a problem where we are given a directed network and are asked to partition the graph into a sequence of coherent groups while attempting to conform to the cross edges. We assume that nodes in the network have features, and we measure the group coherence by comparing these features. Furthermore, we incorporate the cross edges by penalizing the forward cross edges and backward cross edges with different weights. If the weights are set to 0, then the problem is equivalent to clustering. However, if we penalize the backward edges significantly more, then the order of discovered groups matters, and we can view our problem as a generalization of a classic segmentation problem. To solve the algorithm we consider a common iterative approach where we solve the groups given the centroids, and then find the centroids given the groups. We show that - unlike in clustering - the first subproblem is NP-hard. However, we show that if the underlying graph is a tree we can solve the subproblem with dynamic programming. In addition, if the number of groups is 2, we can solve the subproblem with a minimum cut. For the more general case, we propose a heuristic where we optimize each pair of groups separately while keeping the remaining groups intact. We also propose a greedy search where nodes are moved between the groups while optimizing the overall loss. We demonstrate with our experiments that the algorithms are practical and yield interpretable results.


title: Multiple Physics Pretraining for Physical Surrogate Models

abstract: We introduce multiple physics pretraining (MPP), an autoregressive task-agnostic pretraining approach for physical surrogate modeling. MPP involves training large surrogate models to predict the dynamics of multiple heterogeneous physical systems simultaneously by learning features that are broadly useful across diverse physical tasks. In order to learn effectively in this setting, we introduce a shared embedding and normalization strategy that projects the fields of multiple systems into a single shared embedding space. We validate the efficacy of our approach on both pretraining and downstream tasks over a broad fluid mechanics-oriented benchmark. We show that a single MPP-pretrained transformer is able to match or outperform task-specific baselines on all pretraining sub-tasks without the need for finetuning. For downstream tasks, we demonstrate that finetuning MPP-trained models results in more accurate predictions across multiple time-steps on new physics compared to training from scratch or finetuning pretrained video foundation models. We open-source our code and model weights trained at multiple scales for reproducibility and community experimentation.


title: IBCL: Zero-shot Model Generation for Task Trade-offs in Continual Learning

abstract: Like generic multi-task learning, continual learning has the nature of multi-objective optimization, and therefore faces a trade-off between the performance of different tasks. That is, to optimize for the current task distribution, it may need to compromise performance on some previous tasks. This means that there exist multiple models that are Pareto-optimal at different times, each addressing a distinct task performance trade-off. Researchers have discussed how to train particular models to address specific trade-off preferences. However, existing algorithms require training overheads proportional to the number of preferences -- a large burden when there are multiple, possibly infinitely many, preferences. As a response, we propose Imprecise Bayesian Continual Learning (IBCL). Upon a new task, IBCL (1) updates a knowledge base in the form of a convex hull of model parameter distributions and (2) obtains particular models to address task trade-off preferences with zero-shot. That is, IBCL does not require any additional training overhead to generate preference-addressing models from its knowledge base. We show that models obtained by IBCL have guarantees in identifying the Pareto optimal parameters. Moreover, experiments on standard image classification and NLP tasks support this guarantee. Statistically, IBCL improves average per-task accuracy by at most 23\% and peak per-task accuracy by at most 15\% with respect to the baseline methods, with steadily near-zero or positive backward transfer. Most importantly, IBCL significantly reduces the training overhead from training 1 model per preference to at most 3 models for all preferences.


title: Generalized Stochastic Dynamic Aggregative Game for Demand-Side Management in Microgrids with Shared Battery

abstract: In this paper, we focus on modeling and analysis of demand-side management in a microgrid where agents utilize grid energy and a shared battery charged by renewable energy sources. We model the problem as a generalized stochastic dynamic aggregative game with chance constraints that capture the effects of uncertainties in the renewable generation and agents' demands. Computing the solution of the game is a complex task due to probabilistic and coupling constraints among the agents through the state of charge of the shared battery. We investigate the Nash equilibrium of this game under uncertainty considering both the uniqueness of the solution and the effect of uncertainty on the solution. Simulation results demonstrate that the presented stochastic method is superior to deterministic methods.


title: Optimizing Key-Selection for Face-based One-Time Biometrics via Morphing

abstract: Nowadays, facial recognition systems are still vulnerable to adversarial attacks. These attacks vary from simple perturbations of the input image to modifying the parameters of the recognition model to impersonate an authorised subject. So-called privacy-enhancing facial recognition systems have been mostly developed to provide protection of stored biometric reference data, i.e. templates. In the literature, privacy-enhancing facial recognition approaches have focused solely on conventional security threats at the template level, ignoring the growing concern related to adversarial attacks. Up to now, few works have provided mechanisms to protect face recognition against adversarial attacks while maintaining high security at the template level. In this paper, we propose different key selection strategies to improve the security of a competitive cancelable scheme operating at the signal level. Experimental results show that certain strategies based on signal-level key selection can lead to complete blocking of the adversarial attack based on an iterative optimization for the most secure threshold, while for the most practical threshold, the attack success chance can be decreased to approximately 5.0%.


title: ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models

abstract: Large Vision-Language Models (LVLMs) can understand the world comprehensively by integrating rich information from different modalities, achieving remarkable advancements on various multimodal downstream tasks. However, deploying LVLMs is often problematic due to their massive computational/energy costs and carbon consumption. Such issues make it infeasible to adopt conventional iterative global pruning, which is costly due to computing the Hessian matrix of the entire large model for sparsification. Alternatively, several studies have recently proposed layer-wise pruning approaches to avoid the expensive computation of global pruning and efficiently compress model weights according to their importance within a layer. However, they often suffer from suboptimal model compression due to their lack of a global perspective. To address this limitation in recent efficient pruning methods for large models, we propose Efficient Coarse-to-Fine LayerWise Pruning (ECoFLaP), a two-stage coarse-to-fine weight pruning approach for LVLMs. We first determine the sparsity ratios of different layers or blocks by leveraging the global importance score, which is efficiently computed based on the zeroth-order approximation of the global model gradients. Then, the model performs local layer-wise unstructured weight pruning based on globally-informed sparsity ratios. We validate our proposed method across various multimodal and unimodal models and datasets, demonstrating significant performance improvements over prevalent pruning techniques in the high-sparsity regime.


title: Exploring X-ray Properties of Low Metallicity Dwarf Galaxies

abstract: One of the primary outstanding questions in extragalactic astronomy is the formation and early evolution of the supermassive black holes that are seen in nearly every massive galaxy. Low metallicity dwarf galaxies may offer the most representative local analogs to pristine early galaxies, making them a vital tool in probing black hole seed models through the study of the intermediate mass black holes (IMBHs) possibly hosted therein, though these dwarf galaxies, and the IMBHs they may host, are typically not as well-studied in this context as their higher metallicity and higher mass counterparts. In this paper, we explore the X-ray properties of a sample of 37 low metallicity dwarf galaxies using archival XMM observations, and we compare the properties of this population against a representative sample of higher metallicity counterparts. We report the detection of ten sources with 0.3-10 keV luminosity in excess of $10^{40}$~erg~s$^{-1}$ within the low metallicity sample, which we highlight for follow-up as potential intermediate mass black hole candidates. Finally, we discuss the differing multi-wavelength scaling relations (e.g., $L_X - L_{W2}$, $L_X-SFR$) between the two galaxy populations, as well as the sample's $L_X$ as a function of metallicity.


title: A lepton model with nearly Cobimaximal mixing

abstract: Cobimaximal mixing predicts $\pi/4$ and $3\pi/2$ for the atmospheric angle and the Dirac CP-violating phase, respectively. These values are in tension with the neutrino globals fits. If this pattern was behind the lepton mixings, then it would have to be broken. In that case, in this paper, we explore the $\mathbf{S}_{3}$ flavor symmetry within the $B-L$ gauge model where the aforementioned scheme comes from the neutrino sector but the charged lepton contribution breaks the well known predictions so the mixing observables as well as the $m_{ee}$ mass can be accommodated quite well according to the available data. Notably, the predicted regions for the Dirac CP-violating phase would allow us to test the model in future experiments.


title: Learning characteristic parameters and dynamics of centrifugal pumps under multi-phase flow using physics-informed neural networks

abstract: Electrical submersible pumps (ESP) are the second most used artificial lifting equipment in the oil and gas industry due to their high flow rates and boost pressures. They often have to handle multiphase flows, which usually contain a mixture of hydrocarbons, water, and/or sediments. Given these circumstances, emulsions are commonly formed. It is a liquid-liquid flow composed of two immiscible fluids whose effective viscosity and density differ from the single phase separately. In this context, accurate modeling of ESP systems is crucial for optimizing oil production and implementing control strategies. However, real-time and direct measurement of fluid and system characteristics is often impractical due to time constraints and economy. Hence, indirect methods are generally considered to estimate the system parameters. In this paper, we formulate a machine learning model based on Physics-Informed Neural Networks (PINNs) to estimate crucial system parameters. In order to study the efficacy of the proposed PINN model, we conduct computational studies using not only simulated but also experimental data for different water-oil ratios. We evaluate the state variable's dynamics and unknown parameters for various combinations when only intake and discharge pressure measurements are available. We also study structural and practical identifiability analyses based on commonly available pressure measurements. The PINN model could reduce the requirement of expensive field laboratory tests used to estimate fluid properties.


title: No Forking Way: Detecting Cloning Attacks on Intel SGX Applications

abstract: Forking attacks against TEEs like Intel SGX can be carried out either by rolling back the application to a previous state, or by cloning the application and by partitioning its inputs across the cloned instances. Current solutions to forking attacks require Trusted Third Parties (TTP) that are hard to find in real-world deployments. In the absence of a TTP, many TEE applications rely on monotonic counters to mitigate forking attacks based on rollbacks; however, they have no protection mechanism against forking attack based on cloning. In this paper, we analyze 72 SGX applications and show that approximately 20% of those are vulnerable to forking attacks based on cloning - including those that rely on monotonic counters. To address this problem, we present CloneBuster, the first practical clone-detection mechanism for Intel SGX that does not rely on a TTP and, as such, can be used directly to protect existing applications. CloneBuster allows enclaves to (self-) detect whether another enclave with the same binary is running on the same platform. To do so, CloneBuster relies on a cache-based covert channel for enclaves to signal their presence to (and detect the presence of) clones on the same machine. We show that CloneBuster is robust despite a malicious OS, only incurs a marginal impact on the application performance, and adds approximately 800 LoC to the TCB. When used in conjunction with monotonic counters, CloneBuster allows applications to benefit from a comprehensive protection against forking attacks.


title: From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference

abstract: Large language models (LLMs) have exploded in popularity due to their new generative capabilities that go far beyond prior state-of-the-art. These technologies are increasingly being leveraged in various domains such as law, finance, and medicine. However, these models carry significant computational challenges, especially the compute and energy costs required for inference. Inference energy costs already receive less attention than the energy costs of training LLMs -- despite how often these large models are called on to conduct inference in reality (e.g., ChatGPT). As these state-of-the-art LLMs see increasing usage and deployment in various domains, a better understanding of their resource utilization is crucial for cost-savings, scaling performance, efficient hardware usage, and optimal inference strategies. In this paper, we describe experiments conducted to study the computational and energy utilization of inference with LLMs. We benchmark and conduct a preliminary analysis of the inference performance and inference energy costs of different sizes of LLaMA -- a recent state-of-the-art LLM -- developed by Meta AI on two generations of popular GPUs (NVIDIA V100 \& A100) and two datasets (Alpaca and GSM8K) to reflect the diverse set of tasks/benchmarks for LLMs in research and practice. We present the results of multi-node, multi-GPU inference using model sharding across up to 32 GPUs. To our knowledge, our work is the one of the first to study LLM inference performance from the perspective of computational and energy resources at this scale.


title: Soft Convex Quantization: Revisiting Vector Quantization with Convex Optimization

abstract: Vector Quantization (VQ) is a well-known technique in deep learning for extracting informative discrete latent representations. VQ-embedded models have shown impressive results in a range of applications including image and speech generation. VQ operates as a parametric K-means algorithm that quantizes inputs using a single codebook vector in the forward pass. While powerful, this technique faces practical challenges including codebook collapse, non-differentiability and lossy compression. To mitigate the aforementioned issues, we propose Soft Convex Quantization (SCQ) as a direct substitute for VQ. SCQ works like a differentiable convex optimization (DCO) layer: in the forward pass, we solve for the optimal convex combination of codebook vectors that quantize the inputs. In the backward pass, we leverage differentiability through the optimality conditions of the forward solution. We then introduce a scalable relaxation of the SCQ optimization and demonstrate its efficacy on the CIFAR-10, GTSRB and LSUN datasets. We train powerful SCQ autoencoder models that significantly outperform matched VQ-based architectures, observing an order of magnitude better image reconstruction and codebook usage with comparable quantization runtime.


title: Reversing Deep Face Embeddings with Probable Privacy Protection

abstract: Generally, privacy-enhancing face recognition systems are designed to offer permanent protection of face embeddings. Recently, so-called soft-biometric privacy-enhancement approaches have been introduced with the aim of canceling soft-biometric attributes. These methods limit the amount of soft-biometric information (gender or skin-colour) that can be inferred from face embeddings. Previous work has underlined the need for research into rigorous evaluations and standardised evaluation protocols when assessing privacy protection capabilities. Motivated by this fact, this paper explores to what extent the non-invertibility requirement can be met by methods that claim to provide soft-biometric privacy protection. Additionally, a detailed vulnerability assessment of state-of-the-art face embedding extractors is analysed in terms of the transformation complexity used for privacy protection. In this context, a well-known state-of-the-art face image reconstruction approach has been evaluated on protected face embeddings to break soft biometric privacy protection. Experimental results show that biometric privacy-enhanced face embeddings can be reconstructed with an accuracy of up to approximately 98%, depending on the complexity of the protection algorithm.


title: COOLer: Class-Incremental Learning for Appearance-Based Multiple Object Tracking

abstract: Continual learning allows a model to learn multiple tasks sequentially while retaining the old knowledge without the training data of the preceding tasks. This paper extends the scope of continual learning research to class-incremental learning for multiple object tracking (MOT), which is desirable to accommodate the continuously evolving needs of autonomous systems. Previous solutions for continual learning of object detectors do not address the data association stage of appearance-based trackers, leading to catastrophic forgetting of previous classes' re-identification features. We introduce COOLer, a COntrastive- and cOntinual-Learning-based tracker, which incrementally learns to track new categories while preserving past knowledge by training on a combination of currently available ground truth labels and pseudo-labels generated by the past tracker. To further exacerbate the disentanglement of instance representations, we introduce a novel contrastive class-incremental instance representation learning technique. Finally, we propose a practical evaluation protocol for continual learning for MOT and conduct experiments on the BDD100K and SHIFT datasets. Experimental results demonstrate that COOLer continually learns while effectively addressing catastrophic forgetting of both tracking and detection. The code is available at https://github.com/BoSmallEar/COOLer.


title: Towards Domain-Specific Features Disentanglement for Domain Generalization

abstract: Distributional shift between domains poses great challenges to modern machine learning algorithms. The domain generalization (DG) signifies a popular line targeting this issue, where these methods intend to uncover universal patterns across disparate distributions. Noted, the crucial challenge behind DG is the existence of irrelevant domain features, and most prior works overlook this information. Motivated by this, we propose a novel contrastive-based disentanglement method CDDG, to effectively utilize the disentangled features to exploit the over-looked domain-specific features, and thus facilitating the extraction of the desired cross-domain category features for DG tasks. Specifically, CDDG learns to decouple inherent mutually exclusive features by leveraging them in the latent space, thus making the learning discriminative. Extensive experiments conducted on various benchmark datasets demonstrate the superiority of our method compared to other state-of-the-art approaches. Furthermore, visualization evaluations confirm the potential of our method in achieving effective feature disentanglement.


title: SpiDy.jl: open-source Julia package for the study of non-Markovian stochastic dynamics

abstract: SpiDy.jl solves the non-Markovian stochastic dynamics of interacting classical spin vectors and harmonic oscillator networks in contact with a dissipative environment. The methods implemented allow the user to include arbitrary memory effects and colored quantum noise spectra. In this way, SpiDy.jl provides key tools for the simulation of classical and quantum open systems including non-Markovian effects and arbitrarily strong coupling to the environment. Among the wide range of applications, some examples range from atomistic spin dynamics to ultrafast magnetism and the study of anisotropic materials. We provide the user with Julia notebooks to guide them through the various mathematical methods and help them quickly set up complex simulations.

categories: physics.comp-ph cond-mat.stat-mech physics.class-ph quant-ph