title: Platforms for Efficient and Incentive-Aware Collaboration

abstract: Collaboration is crucial for reaching collective goals. However, its effectiveness is often undermined by the strategic behavior of individual agents -- a fact that is captured by a high Price of Stability (PoS) in recent literature [Blum et al., 2021]. Implicit in the traditional PoS analysis is the assumption that agents have full knowledge of how their tasks relate to one another. We offer a new perspective on bringing about efficient collaboration among strategic agents using information design. Inspired by the growing importance of collaboration in machine learning (such as platforms for collaborative federated learning and data cooperatives), we propose a framework where the platform has more information about how the agents' tasks relate to each other than the agents themselves. We characterize how and to what degree such platforms can leverage their information advantage to steer strategic agents toward efficient collaboration. Concretely, we consider collaboration networks where each node is a task type held by one agent, and each task benefits from contributions made in their inclusive neighborhood of tasks. This network structure is known to the agents and the platform, but only the platform knows each agent's real location -- from the agents' perspective, their location is determined by a random permutation. We employ private Bayesian persuasion and design two families of persuasive signaling schemes that the platform can use to ensure a small total workload when agents follow the signal. The first family aims to achieve the minmax optimal approximation ratio compared to the optimal collaboration, which is shown to be $\Theta(\sqrt{n})$ for unit-weight graphs, $\Theta(n^{2/3})$ for graphs with constant minimum edge weights, and $O(n^{3/4})$ for general weighted graphs. The second family ensures per-instance strict improvement compared to full information disclosure.


title: The Surprising Effectiveness of Skip-Tuning in Diffusion Sampling

abstract: With the incorporation of the UNet architecture, diffusion probabilistic models have become a dominant force in image generation tasks. One key design in UNet is the skip connections between the encoder and decoder blocks. Although skip connections have been shown to improve training stability and model performance, we reveal that such shortcuts can be a limiting factor for the complexity of the transformation. As the sampling steps decrease, the generation process and the role of the UNet get closer to the push-forward transformations from Gaussian distribution to the target, posing a challenge for the network's complexity. To address this challenge, we propose Skip-Tuning, a simple yet surprisingly effective training-free tuning method on the skip connections. Our method can achieve 100% FID improvement for pretrained EDM on ImageNet 64 with only 19 NFEs (1.75), breaking the limit of ODE samplers regardless of sampling steps. Surprisingly, the improvement persists when we increase the number of sampling steps and can even surpass the best result from EDM-2 (1.58) with only 39 NFEs (1.57). Comprehensive exploratory experiments are conducted to shed light on the surprising effectiveness. We observe that while Skip-Tuning increases the score-matching losses in the pixel space, the losses in the feature space are reduced, particularly at intermediate noise levels, which coincide with the most effective range accounting for image quality improvement.


title: Covariance-Adaptive Least-Squares Algorithm for Stochastic Combinatorial Semi-Bandits

abstract: We address the problem of stochastic combinatorial semi-bandits, where a player can select from P subsets of a set containing d base items. Most existing algorithms (e.g. CUCB, ESCB, OLS-UCB) require prior knowledge on the reward distribution, like an upper bound on a sub-Gaussian proxy-variance, which is hard to estimate tightly. In this work, we design a variance-adaptive version of OLS-UCB, relying on an online estimation of the covariance structure. Estimating the coefficients of a covariance matrix is much more manageable in practical settings and results in improved regret upper bounds compared to proxy variance-based algorithms. When covariance coefficients are all non-negative, we show that our approach efficiently leverages the semi-bandit feedback and provably outperforms bandit feedback approaches, not only in exponential regimes where P $\gg$ d but also when P $\le$ d, which is not straightforward from most existing analyses.


title: Attention-Guided Masked Autoencoders For Learning Image Representations

abstract: Masked autoencoders (MAEs) have established themselves as a powerful method for unsupervised pre-training for computer vision tasks. While vanilla MAEs put equal emphasis on reconstructing the individual parts of the image, we propose to inform the reconstruction process through an attention-guided loss function. By leveraging advances in unsupervised object discovery, we obtain an attention map of the scene which we employ in the loss function to put increased emphasis on reconstructing relevant objects, thus effectively incentivizing the model to learn more object-focused representations without compromising the established masking strategy. Our evaluations show that our pre-trained models learn better latent representations than the vanilla MAE, demonstrated by improved linear probing and k-NN classification results on several benchmarks while at the same time making ViTs more robust against varying backgrounds.


title: Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer

abstract: Fine-tuning large language models (LLMs) with classic first-order optimizers entails prohibitive GPU memory due to the backpropagation process. Recent works have turned to zeroth-order optimizers for fine-tuning, which save substantial memory by using two forward passes. However, these optimizers are plagued by the heterogeneity of parameter curvatures across different dimensions. In this work, we propose HiZOO, a diagonal Hessian informed zeroth-order optimizer which is the first work to leverage the diagonal Hessian to enhance zeroth-order optimizer for fine-tuning LLMs. What's more, HiZOO avoids the expensive memory cost and only increases one forward pass per step. Extensive experiments on various models (350M~66B parameters) indicate that HiZOO improves model convergence, significantly reducing training steps and effectively enhancing model accuracy. Moreover, we visualize the optimization trajectories of HiZOO on test functions, illustrating its effectiveness in handling heterogeneous curvatures. Lastly, we provide theoretical proofs of convergence for HiZOO. Code is publicly available at https://anonymous.4open.science/r/HiZOO27F8.


title: The Flower Calculus

abstract: We introduce the flower calculus, a deep inference proof system for intuitionistic first-order logic inspired by Peirce's existential graphs. It works as a rewriting system over inductive objects called "flowers", that enjoy both a graphical interpretation as topological diagrams, and a textual presentation as nested sequents akin to coherent formulas. Importantly, the calculus dispenses completely with the traditional notion of symbolic connective, operating solely on nested flowers containing atomic predicates. We prove both the soundness of the full calculus and the completeness of an analytic fragment with respect to Kripke semantics. This provides to our knowledge the first analyticity result for a proof system based on existential graphs, adapting semantic cut-elimination techniques to a deep inference setting. Furthermore, the kernel of rules targetted by completeness is fully invertible, a desirable property for both automated and interactive proof search.


title: Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition

abstract: Recent studies have uncovered intriguing phenomena in deep learning, such as grokking, double descent, and emergent abilities in large language models, which challenge human intuition and are crucial for a deeper understanding of neural models. In this paper, we present a comprehensive framework that provides a unified view of these three phenomena, focusing on the competition between memorization and generalization circuits. This approach, initially employed to explain grokking, is extended in our work to encompass a wider range of model sizes and training data volumes. Our framework delineates four distinct training dynamics, each depending on varying combinations of model size and training data quantity. Utilizing this framework, we provide a detailed analysis of the double descent phenomenon and propose two verifiable predictions regarding its occurrence, both substantiated by our experimental results. Moreover, we expand our framework to the multi-task learning paradigm, demonstrating how algorithm tasks can be turned into emergent abilities. This offers a novel perspective to understand emergent abilities in Large Language Models.


title: The Influence of Fin Shape on the Amplitude of Random Telegraph Noise in the Subthreshold Regime of a Junctionless FinFET

abstract: The dependence of random telegraph noise (RTN) amplitude on the gate overdrive in a junctionless field-effect transistor (FinFET) with rectangular and trapezoidal channel (fin) cross sections manufactured using silicon-on-insulator technology has been numerically simulated. It is established that the RTN amplitude in the subthreshold region of gate voltages for a FinFET with a trapezoidal cross-section of the channel is significantly lower than that for the transistor with a rectangular cross-section of a channel. In addition, under the same conditions, the RTN amplitude at the threshold gate voltage in a junctionless FinFET is significantly lower than that in planar fully depleted and in usual FinFET.


title: Validation of the VUV-reflective coating for next-generation liquid xenon detectors

abstract: Coating detector materials with films highly reflective in the ultraviolet region improves sensitivity of the rare-event detectors that use liquid xenon. In this work, we investigate the MgF$_2$-Al-MgF$_2$ coating designed to achieve high reflectance at 175 nm, the mean wavelength of liquid xenon (LXe) scintillation. The coating was applied to an unpolished, passivated copper substrate mimicking a realistic detector component of the proposed nEXO experiment, as well as to two unpassivated substrates with "high" and "average" levels of polishing. After confirming the composition and morphology of the thin-film coating using TEM and EDS, the samples underwent reflectance measurements in LXe and gaseous nitrogen (GN2). Measurements in LXe exposed the coated samples to -100 $\deg$C for several hours. No peeling of the coatings was observed after several thermal cycles. Polishing is found to strongly correlate with the measured specular reflectance ($R_{\mathrm{spec}}$). In particular, 5.8(5)% specular spike reflectance in LXe was measured for the realistic sample at 20$\deg$ of incidence, while the values for similar angles of incidence on the high and average polish samples are 62.3(1.3)% and 27.4(7)%, respectively. At large angles (66\deg--75$\deg$), the $R_{\mathrm{spec}}$ in LXe for the three samples increases to 23(5)%, 80(8)%, and 84(18)%, respectively. The $R_{\mathrm{spec}}$ at around 45$\deg$ was measured in both GN2 and LXe for average polish sample and shows a reasonable agreement. Importantly, the total reflectance of the samples is comparable and estimated to be 92(8)%, 85(8)%, and 83(8)% in GN2 for the realistic, average, and high polish samples, respectively. This is considered satisfactory for the next-generation LXe experiments that could benefit from using reflective films, such as nEXO and DARWIN, thus validating the design of the coating.


title: Traversable wormholes satisfying energy conditions in $f(Q)$ gravity

abstract: In this article, a new family of asymptotically flat wormhole solutions in the context of symmetric teleparallel gravity, i.e., $f(Q)$ theory of gravity, are presented. Considering a power-law shape function and some different forms for $f(Q)$ function, we show that a wide variety of wormhole solutions for which the matter fields satisfy some energy conditions, are accessible. We explore that the presence of $f(Q)$ gravity will be enough to sustain a traversable wormhole without exotic matter. The influence of free parameters in shape function and $f(Q)$ models on the energy conditions is investigated. The equation of state and boundary conditions are analyzed.


title: Advancing Parameter Efficiency in Fine-tuning via Representation Editing

abstract: Parameter Efficient Fine-Tuning (PEFT) techniques have drawn significant attention due to their ability to yield competitive results while updating only a small portion of the adjustable parameters. However, existing PEFT methods pose challenges in hyperparameter selection, such as choosing the rank for LoRA or Adapter, or specifying the length of soft prompts. To address these challenges, we propose a novel fine-tuning approach for neural models, named Representation EDiting (RED), which modifies the representations generated at some layers through the application of scaling and biasing operations. While existing PEFT methods still demonstrate over-parameterization that could potentially undermine the generalization ability acquired from pre-training, RED can substantially reduce the number of trainable parameters by a factor of 25, 700 compared to full parameter fine-tuning and by a factor of 32 relative to LoRA. Remarkably, RED achieves results comparable or superior to both full parameter fine-tuning and other PEFT methods. Extensive experiments across various model architectures and scales, including RoBERTa, GPT-2, T5, and LLaMA-2, have demonstrated the effectiveness and efficiency of RED1, thereby positioning it as a promising PEFT strategy for large-scale neural models.


title: Break the Breakout: Reinventing LM Defense Against Jailbreak Attacks with Self-Refinement

abstract: Caution: This paper includes offensive words that could potentially cause unpleasantness. Language models (LMs) are vulnerable to exploitation for adversarial misuse. Training LMs for safety alignment is extensive and makes it hard to respond to fast-developing attacks immediately, such as jailbreaks. We propose self-refine with formatting that achieves outstanding safety even in non-safety-aligned LMs and evaluate our method alongside several defense baselines, demonstrating that it is the safest training-free method against jailbreak attacks. Additionally, we proposed a formatting method that improves the efficiency of the self-refine process while reducing attack success rates in fewer iterations. We've also observed that non-safety-aligned LMs outperform safety-aligned LMs in safety tasks by giving more helpful and safe responses. In conclusion, our findings can achieve less safety risk with fewer computational costs, allowing non-safety LM to be easily utilized in real-world service.


title: Substrate Prediction for RiPP Biosynthetic Enzymes via Masked Language Modeling and Transfer Learning

abstract: Ribosomally synthesized and post-translationally modified peptide (RiPP) biosynthetic enzymes often exhibit promiscuous substrate preferences that cannot be reduced to simple rules. Large language models are promising tools for predicting such peptide fitness landscapes. However, state-of-the-art protein language models are trained on relatively few peptide sequences. A previous study comprehensively profiled the peptide substrate preferences of LazBF (a two-component serine dehydratase) and LazDEF (a three-component azole synthetase) from the lactazole biosynthetic pathway. We demonstrated that masked language modeling of LazBF substrate preferences produced language model embeddings that improved downstream classification models of both LazBF and LazDEF substrates. Similarly, masked language modeling of LazDEF substrate preferences produced embeddings that improved the performance of classification models of both LazBF and LazDEF substrates. Our results suggest that the models learned functional forms that are transferable between distinct enzymatic transformations that act within the same biosynthetic pathway. Our transfer learning method improved performance and data efficiency in data-scarce scenarios. We then fine-tuned models on each data set and showed that the fine-tuned models provided interpretable insight that we anticipate will facilitate the design of substrate libraries that are compatible with desired RiPP biosynthetic pathways.


title: Influence of microstructure on mass loss caused by acoustic and hydrodynamic cavitation

abstract: The proposed study investigates the damage mechanisms of martensitic stainless steel X3CrNiMo13-4 exposed to cavitation using two complementary experimental apparatus: ultrasonic horn (MUCEF) and hydrodynamic tunnel (PREVERO). Cavitation testing has been carried out on two different metallurgical states: QT780 and QT900 corresponding to coarse and fine microstructure respectively. Acoustic cavitation erosion tests have been performed on the MUCEF equipment inspired from the ASTM G32 standards but specially designed to be installed inside X-Ray tomographs. The ultrasonic horn operates at 20 kHz and the tested specimen is located at 500 $\mu$m from the horn tip. Hydrodynamic cavitation erosion tests were conducted with classic experimental conditions of PREVERO device: a cavitation number of 0.87 corresponding to a flow velocity of 90 m.s-1 and an upstream pressure of 40 bars. For acoustic cavitation, mass loss has been identified as dependent of the microstructure while for hydrodynamic cavitation the mass loss is identical whatever the microstructure size.


title: GraphEdit: Large Language Models for Graph Structure Learning

abstract: Graph Structure Learning (GSL) focuses on capturing intrinsic dependencies and interactions among nodes in graph-structured data by generating novel graph structures. Graph Neural Networks (GNNs) have emerged as promising GSL solutions, utilizing recursive message passing to encode node-wise inter-dependencies. However, many existing GSL methods heavily depend on explicit graph structural information as supervision signals, leaving them susceptible to challenges such as data noise and sparsity. In this work, we propose GraphEdit, an approach that leverages large language models (LLMs) to learn complex node relationships in graph-structured data. By enhancing the reasoning capabilities of LLMs through instruction-tuning over graph structures, we aim to overcome the limitations associated with explicit graph structural information and enhance the reliability of graph structure learning. Our approach not only effectively denoises noisy connections but also identifies node-wise dependencies from a global perspective, providing a comprehensive understanding of the graph structure. We conduct extensive experiments on multiple benchmark datasets to demonstrate the effectiveness and robustness of GraphEdit across various settings. We have made our model implementation available at: https://github.com/HKUDS/GraphEdit.


title: A Linear Inverse Model for Colored-Gaussian Noise

abstract: We propose a novel data-driven linear inverse model, called Colored-LIM, to extract the linear dynamics and diffusion matrix that define a linear stochastic process driven by an Ornstein-Uhlenbeck colored-noise. The Colored-LIM is a new variant of the classical linear inverse model (LIM) which relies on the white noise assumption. Similar to LIM, the Colored-LIM approximates the linear dynamics from a finite realization of a stochastic process and then solves the diffusion matrix based on, for instance, a generalized fluctuation-dissipation relation, which can be done by solving a system of linear equations. The main difficulty is that in practice, the colored-noise process can be hardly observed while it is correlated to the stochastic process of interest. Nevertheless, we show that the local behavior of the correlation function of the observable encodes the dynamics of the stochastic process and the diffusive behavior of the colored-noise. In this article, we review the classical LIM and develop Colored-LIM with a mathematical background and rigorous derivations. In the numerical experiments, we examine the performance of both LIM and Colored-LIM. Finally, we discuss some false attempts to build a linear inverse model for colored-noise driven processes, and investigate the potential misuse and its consequence of LIM in the appendices.


title: Pre-Chirp-Domain Index Modulation for Affine Frequency Division Multiplexing

abstract: Affine frequency division multiplexing (AFDM), tailored as a novel multicarrier technique utilizing chirp signals for high-mobility communications, exhibits marked advantages compared to traditional orthogonal frequency division multiplexing (OFDM). AFDM is based on the discrete affine Fourier transform (DAFT) with two modifiable parameters of the chirp signals, termed as the pre-chirp parameter and post-chirp parameter, respectively. These parameters can be fine-tuned to avoid overlapping channel paths with different delays or Doppler shifts, leading to performance enhancement especially for doubly dispersive channel. In this paper, we propose a novel AFDM structure with the pre-chirp index modulation (PIM) philosophy (AFDM-PIM), which can embed additional information bits into the pre-chirp parameter design for both spectral and energy efficiency enhancement. Specifically, we first demonstrate that the application of distinct pre-chirp parameters to various subcarriers in the AFDM modulation process maintains the orthogonality among these subcarriers. Then, different pre-chirp parameters are flexibly assigned to each AFDM subcarrier according to the incoming bits. By such arrangement, aside from classical phase/amplitude modulation, extra binary bits can be implicitly conveyed by the indices of selected pre-chirping parameters realizations without additional energy consumption. At the receiver, both a maximum likelihood (ML) detector and a reduced-complexity ML-minimum mean square error (ML-MMSE) detector are employed to recover the information bits. It has been shown via simulations that the proposed AFDM-PIM exhibits superior bit error rate (BER) performance compared to classical AFDM, OFDM and IM-aided OFDM algorithms.


title: Ten computational challenges in human virome studies

abstract: In recent years, substantial advancements have been achieved in understanding the diversity of the human virome and its intricate roles in human health and diseases. Despite this progress, the field of human virome research remains nascent, primarily hindered by the absence of effective methods, particularly in the domain of computational tools. This perspective systematically outlines ten computational challenges spanning various phases of virome studies, ranging from virus identification, sequencing quality evaluation, genome assembly, annotation of viral taxonomy, genome and proteins, inference of biological properties, applications of the virome in disease diagnosis, interactions with other microbes, and associations with human diseases. The resolution of these challenges necessitates ongoing collaboration among computational scientists, virologists, and multidisciplinary experts. In essence, this perspective serves as a comprehensive guide for directing computational efforts in human virome studies, aiming to significantly propel the field forward.


title: Ultra-short lifetime isomer studies from photonuclear reactions using laser-driven ultra-intense {\gamma}-ray

abstract: Isomers, ubiquitous populations of relatively long-lived nuclear excited states, play a crucial role in nuclear physics. However, isomers with half-life times of several seconds or less barely had experimental cross section data due to the lack of a suitable measuring method. We report a method of online {\gamma} spectroscopy for ultra-short-lived isomers from photonuclear reactions using laser-driven ultra-intense {\gamma}-rays. The fastest time resolution can reach sub-ps level with {\gamma}-ray intensities >10^{19}/s ({\geqslant} 8 MeV). The ^{115}In({\gamma}, n)^{114m2}In reaction (T_{1/2} = 43.1 ms) was first measured in the high-energy region which shed light on the nuclear structure studies of In element. Simulations showed it would be an efficient way to study ^{229m}Th (T_{1/2} = 7 {\mu}s), which is believed to be the next generation of nuclear clock. This work offered a unique way of gaining insight into ultra-short lifetimes and promised an effective way to fill the gap in relevant experimental data.


title: Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions

abstract: This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient parameter-free optimistic optimization-based methods. Our algorithms significantly improve upon the existing Lipschitz bandit-based method in many aspects. In particular, our framework does not require knowledge about the sensitivity parameter of the distribution map and the Lipshitz constant of the loss function. This makes our framework practically favorable, together with the efficient optimistic optimization-based tree-search mechanism. We provide experimental results that demonstrate the numerical superiority of our algorithms over the existing method and other black-box optimistic optimization methods.


abstract: Although biomedical entity linking (BioEL) has made significant progress with pre-trained language models, challenges still exist for fine-grained and long-tailed entities. To address these challenges, we present BioELQA, a novel model that treats Biomedical Entity Linking as Multiple Choice Question Answering. BioELQA first obtains candidate entities with a fast retriever, jointly presents the mention and candidate entities to a generator, and then outputs the predicted symbol associated with its chosen entity. This formulation enables explicit comparison of different candidate entities, thus capturing fine-grained interactions between mentions and entities, as well as among entities themselves. To improve generalization for long-tailed entities, we retrieve similar labeled training instances as clues and concatenate the input with retrieved instances for the generator. Extensive experimental results show that BioELQA outperforms state-of-the-art baselines on several datasets.


title: Asymptotics of the Smallest Eigenvalue Distributions of Freud Unitary Ensembles

abstract: We consider the smallest eigenvalue distributions of some Freud unitary ensembles, that is, the probabilities that all the eigenvalues of the Hermitian matrices from the ensembles lie in the interval $(t,\infty)$. This problem is related to the Hankel determinants generated by the Freud weights with a jump discontinuity. By using Chen and Ismail's ladder operator approach, we obtain the discrete systems for the recurrence coefficients of the corresponding orthogonal polynomials. This enables us to derive the large $n$ asymptotics of the recurrence coefficients via Dyson's Coulomb fluid approach. We finally obtain the large $n$ asymptotics of the Hankel determinants and that of the probabilities from their relations to the recurrence coefficients and with the aid of some recent results in the literature.


title: A Digital Twinning Platform for Integrated Sensing, Communications and Robotics

abstract: In this paper, a digital twinning framework for indoor integrated sensing, communications, and robotics is proposed, designed, and implemented. Besides leveraging powerful robotics and ray-tracing technologies, the framework also enables integration with real-world sensors and reactive updates triggered by changes in the environment. The framework is designed with commercial, off-the-shelf components in mind, thus facilitating experimentation in the different areas of communication, sensing, and robotics. Experimental results showcase the feasibility and accuracy of indoor localization using digital twins and validate our implementation both qualitatively and quantitatively.

categories: cs.RO cs.IT cs.SY eess.SP eess.SY math.IT


title: Exact equilibrium properties of square-well and square-shoulder disks in single-file confinement

abstract: This study investigates the (longitudinal) thermodynamic and structural characteristics of single-file confined square-well and square-shoulder disks by employing a mapping technique that transforms the original system into a one-dimensional polydisperse mixture of nonadditive rods. Leveraging standard statistical-mechanical techniques, exact results are derived for key properties, including the equation of state, internal energy, radial distribution function, and structure factor. The asymptotic behavior of the radial distribution function is explored, revealing structural changes in the spatial correlations. Additionally, exact analytical expressions for the second virial coefficient are presented. Comparisons with Monte Carlo simulations demonstrate an excellent agreement with theory.


title: Time-Varying Wireless Power Transfer Systems for Improving Efficiency

abstract: Conventional wireless power transfer systems are linear and time-invariant, which sets fundamental limitations on their performance, including a tradeoff between transfer efficiency and the level of transferred power. In this paper, we introduce and study a possibility of temporal modulation for inductive wireless power transfer systems and uncover that this tradeoff is avoided as a consequence of varying the inductive coupling strength in time. Our theoretical analysis reveals that under the optimal modulation depth and phase, the time modulation can yield a substantial improvement in the WPT efficiency, while the received power at the load is also improved compared to the static WPT reference system. We experimentally demonstrate the concept with a low-frequency system and observe a threefold improvement in efficiency over the reference static counterpart. This technical capability reconciles the inherent tradeoff between the WPT efficiency and transferred power, paving the way for simultaneous advancements in both efficiency and delivered power.


title: Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Control

abstract: Diffusion models excel at capturing complex data distributions, such as those of natural images and proteins. While diffusion models are trained to represent the distribution in the training dataset, we often are more concerned with other properties, such as the aesthetic quality of the generated images or the functional properties of generated proteins. Diffusion models can be finetuned in a goal-directed way by maximizing the value of some reward function (e.g., the aesthetic quality of an image). However, these approaches may lead to reduced sample diversity, significant deviations from the training data distribution, and even poor sample quality due to the exploitation of an imperfect reward function. The last issue often occurs when the reward function is a learned model meant to approximate a ground-truth "genuine" reward, as is the case in many practical applications. These challenges, collectively termed "reward collapse," pose a substantial obstacle. To address this reward collapse, we frame the finetuning problem as entropy-regularized control against the pretrained diffusion model, i.e., directly optimizing entropy-enhanced rewards with neural SDEs. We present theoretical and empirical evidence that demonstrates our framework is capable of efficiently generating diverse samples with high genuine rewards, mitigating the overoptimization of imperfect reward models.


title: The AffectToolbox: Affect Analysis for Everyone

abstract: In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to support researchers in developing affect-sensitive studies and prototypes. The proposed system addresses the challenges posed by existing frameworks, which often require profound programming knowledge and cater primarily to power-users or skilled developers. Aiming to facilitate ease of use, the AffectToolbox requires no programming knowledge and offers its functionality to reliably analyze the affective state of users through an accessible graphical user interface. The architecture encompasses a variety of models for emotion recognition on multiple affective channels and modalities, as well as an elaborate fusion system to merge multi-modal assessments into a unified result. The entire system is open-sourced and will be publicly available to ensure easy integration into more complex applications through a well-structured, Python-based code base - therefore marking a substantial contribution toward advancing affective computing research and fostering a more collaborative and inclusive environment within this interdisciplinary field.


title: Compact on-chip power splitter based on topological photonic crystal

abstract: We propose and demonstrate an on-chip 1*N power splitter based on topological photonic crystal (TPC) on a monolithic silicon photonic platform. Benefiting from the valley-locked propagation mode at the interface of TPCs with different topological phases, the proposed power splitter has negligible backscattering around the sharp bendings and good robustness to fabrication defects, which therefore enable lower insertion loss, better uniformity, and more compact footprint than the conventional designs. For the fabricated 1*2 (8) power splitter, the uniformity among the output ports is below 0.35 (0.65) dB and the maximum insertion loss is 0.38 (0.58) dB with compact footprint of 5*5 um2 (10*12 um2) within a bandwidth of 70 nm. In addition, the topological power splitter only requires simple configurations of TPCs with different topological phases, which is more reliable in design and fabrication compared with the conventional designs.


title: Safety Optimized Reinforcement Learning via Multi-Objective Policy Optimization

abstract: Safe reinforcement learning (Safe RL) refers to a class of techniques that aim to prevent RL algorithms from violating constraints in the process of decision-making and exploration during trial and error. In this paper, a novel model-free Safe RL algorithm, formulated based on the multi-objective policy optimization framework is introduced where the policy is optimized towards optimality and safety, simultaneously. The optimality is achieved by the environment reward function that is subsequently shaped using a safety critic. The advantage of the Safety Optimized RL (SORL) algorithm compared to the traditional Safe RL algorithms is that it omits the need to constrain the policy search space. This allows SORL to find a natural tradeoff between safety and optimality without compromising the performance in terms of either safety or optimality due to strict search space constraints. Through our theoretical analysis of SORL, we propose a condition for SORL's converged policy to guarantee safety and then use it to introduce an aggressiveness parameter that allows for fine-tuning the mentioned tradeoff. The experimental results obtained in seven different robotic environments indicate a considerable reduction in the number of safety violations along with higher, or competitive, policy returns, in comparison to six different state-of-the-art Safe RL methods. The results demonstrate the significant superiority of the proposed SORL algorithm in safety-critical applications.


title: Bidirectional Uncertainty-Based Active Learning for Open Set Annotation

abstract: Active learning (AL) in open set scenarios presents a novel challenge of identifying the most valuable examples in an unlabeled data pool that comprises data from both known and unknown classes. Traditional methods prioritize selecting informative examples with low confidence, with the risk of mistakenly selecting unknown-class examples with similarly low confidence. Recent methods favor the most probable known-class examples, with the risk of picking simple already mastered examples. In this paper, we attempt to query examples that are both likely from known classes and highly informative, and propose a \textit{Bidirectional Uncertainty-based Active Learning} (BUAL) framework. Specifically, we achieve this by first pushing the unknown class examples toward regions with high-confidence predictions with our proposed \textit{Random Label Negative Learning} method. Then, we propose a \textit{Bidirectional Uncertainty sampling} strategy by jointly estimating uncertainty posed by both positive and negative learning to perform consistent and stable sampling. BUAL successfully extends existing uncertainty-based AL methods to complex open-set scenarios. Extensive experiments on multiple datasets with varying openness demonstrate that BUAL achieves state-of-the-art performance.


title: Dynamics and energetics of ion adsorption at the interface between a pure ionic liquid and carbon electrodes

abstract: Molecular dynamics simulations have been used extensively to determine equilibrium properties of the electrode-electrolyte interface in supercapacitors held at various potentials. While such studies are essential to understand and optimize the performance of such energy storage systems, investigations of the dynamics of adsorption during the charge of the supercapacitors is also necessary. Dynamical properties are especially important to get an insight into the power density of supercapacitors, one of their main assets. In this work, we propose a new method to analyze the trajectories of adsorbing ions. We focus on pure 1-ethyl-3-methylimidazolium bis(trifluoromethylsulfonyl)imide in contact with planar carbon electrodes. We characterize the evolution of the ion orientation and ion-electrode distance during adsorption and show that ions reorientate as they adsorb. We then determine the forces experienced by the adsorbing ions and demonstrate that Coulomb forces dominate at long range while van der Waals forces dominate at short range. We also show that there is an almost equal contribution from the two forces at an intermediate distance, explaining the peak of ion density close to the electrode surface.


title: DeMPT: Decoding-enhanced Multi-phase Prompt Tuning for Making LLMs Be Better Context-aware Translators

abstract: Generally, the decoder-only large language models (LLMs) are adapted to context-aware neural machine translation (NMT) in a concatenating way, where LLMs take the concatenation of the source sentence (i.e., intra-sentence context) and the inter-sentence context as the input, and then to generate the target tokens sequentially. This adaptation strategy, i.e., concatenation mode, considers intra-sentence and inter-sentence contexts with the same priority, despite an apparent difference between the two kinds of contexts. In this paper, we propose an alternative adaptation approach, named Decoding-enhanced Multi-phase Prompt Tuning (DeMPT), to make LLMs discriminately model and utilize the inter- and intra-sentence context and more effectively adapt LLMs to context-aware NMT. First, DeMPT divides the context-aware NMT process into three separate phases. During each phase, different continuous prompts are introduced to make LLMs discriminately model various information. Second, DeMPT employs a heuristic way to further discriminately enhance the utilization of the source-side inter- and intra-sentence information at the final decoding phase. Experiments show that our approach significantly outperforms the concatenation method, and further improves the performance of LLMs in discourse modeling.


title: Gallagher-Moszkowski splitting in deformed odd-odd nuclei within a microscopic approach

abstract: Low-lying bandhead states in axially prolate deformed odd-odd nuclei have long been described essentially within the rotor+two-quasiparticle picture. This approach allows one to explain the appearance of so-called Gallagher-Moszkowski doublets of bandheads with $K = \Omega_n \pm \Omega_p$, sum and difference of neutron and proton angular momentum projections on the symmetry axis. According to an empirical rule stated by Gallagher and Moszkowski the spin-aligned configuration lies lower in energy than the spin-anti-aligned configuration. A recent study by Robledo, Bernard and Bertsch in Phys. Rev. C 89, 021303(R) (2014) within the Gogny energy-density functional with selfconsistent blocking of the unpaired nucleons showed that calculations fail to reproduce this rule in about half of the cases and points to the density-dependent term of the functional as responsible of this failure. In this paper we aim at pushing further this analysis to exhibit the mechanism underlying the energy splitting in a Gallagher-Moszkowski doublet. We work in the framework of the Skyrme energy-density functional approach, including BCS pairing correlations with selfconsistent blocking. We use the SIII parametrization with time-odd terms and seniority pairing matrix elements extending a previous study of K-isomeric states in even-even nuclei [Phys. Rev. C 105, 044329 (2022)]. We find that the energy splitting results from a competition between the spin-spin, density-dependent and current-current terms of the Skyrme energy-density functional. In doublets where the larger K value is lower in energy the Gallagher-Moszkowski rule is always satisfied by the SIII Skyrme energy-density functional. In doublets, on the contrary, where the smaller K value lies lower, the energy splittings are calculated to be rather small and often a disagreement with the Gallagher-Moszkowski rule occurs.


title: Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models

abstract: Impressive results have been achieved in natural language processing (NLP) tasks through the training of large language models (LLMs). However, these models occasionally produce toxic content such as insults, threats, and profanity in response to certain prompts, thereby constraining their practical utility. To tackle this issue, various finetuning-based and decoding-based approaches have been utilized to mitigate toxicity. However, these methods typically necessitate additional costs such as high-quality training data or auxiliary models. In this paper, we propose fine-grained detoxification via instance-level prefixes (FGDILP) to mitigate toxic text without additional cost. Specifically, FGDILP contrasts the contextualized representation in attention space using a positive prefix-prepended prompt against multiple negative prefix-prepended prompts at the instance level. This allows for constructing fine-grained subtoxicity vectors, which enables collaborative detoxification by fusing them to correct the normal generation process when provided with a raw prompt. We validate that FGDILP enables controlled text generation with regard to toxicity at both the utterance and context levels. Our method surpasses prompt-based baselines in detoxification, although at a slight cost to generation fluency and diversity.


title: Polarization splitter rotator on thin film lithium niobate based on multimode interference

abstract: Polarization splitter-rotators (PSRs) are the key elements to realize on-chip polarization manipulation. Current PSRs on thin film lithium niobate (TFLN) rely on sub-micron gaps to realize modes separation, which increase the difficulties of lithography and etching. In this paper, a polarization splitter-rotator on TFLN based on multimode interference (MMI) is demonstrated. Mode division is achieved by an MMI-based mode demultiplexer. The feature size of the PSR is 1.5 {\mu}m, which can be fabricated with low priced i-line contact aligners. Experimental results show a polarization extinction ratio (PER) > 20 dB and insertion loss (IL) <1.5 dB are achieved in a wavelength range of 1542-1600 nm for TE-polarized light. And a PER > 9.5 dB and an IL <3.0 dB are achieved in a wavelength range of 1561-1600 nm for TM-polarized light. This PSR could find application in the low-cost fabrication of dual-polarization TFLN integrated photonic devices.


title: How do wavelength correlations affect transmission spectra? Application of a new fast and flexible 2D Gaussian process framework to transiting exoplanet spectroscopy

abstract: The use of Gaussian processes (GPs) is a common approach to account for correlated noise in exoplanet time series, particularly for transmission and emission spectroscopy. This analysis has typically been performed for each wavelength channel separately, with the retrieved uncertainties in the transmission spectrum assumed to be independent. However, the presence of noise correlated in wavelength could cause these uncertainties to be correlated, which could significantly affect the results of atmospheric retrievals. We present a method that uses a GP to model noise correlated in both wavelength and time simultaneously for the full spectroscopic dataset while avoiding the use of a 'common-mode' correction. To make this analysis computationally tractable, we introduce a new fast and flexible GP method that can analyse 2D datasets when the input points lie on a (potentially non-uniform) 2D grid - in our case a time by wavelength grid - and the kernel function has a Kronecker product structure. This simultaneously fits all light curves and enables the retrieval of the covariance matrix of the transmission spectrum. By testing on synthetic datasets, we demonstrate that our new approach can reliably recover atmospheric features contaminated by noise correlated in time and wavelength. In contrast, fitting each spectroscopic light curve separately performed poorly when wavelength-correlated noise was present. It frequently underestimated the uncertainty of the scattering slope and overestimated the uncertainty in the strength of sharp absorption peaks in transmission spectra. Two archival VLT/FORS2 transit observations of WASP-31b were re-analysed, with our method strongly constraining the presence of wavelength-correlated noise in both datasets and recovering significantly different constraints on atmospheric features such as the scattering slope and strength of sodium and potassium features.


title: Enhancing ICU Patient Recovery: Using LLMs to Assist Nurses in Diary Writing

abstract: Intensive care unit (ICU) patients often develop new health-related problems in their long-term recovery. Health care professionals keeping a diary of a patient's stay is a proven strategy to tackle this but faces several adoption barriers, such as lack of time and difficulty in knowing what to write. Large language models (LLMs), with their ability to generate human-like text and adaptability, could solve these challenges. However, realizing this vision involves addressing several socio-technical and practical research challenges. This paper discusses these challenges and proposes future research directions to utilize the potential of LLMs in ICU diary writing, ultimately improving the long-term recovery outcomes for ICU patients.


title: Source-Guided Similarity Preservation for Online Person Re-Identification

abstract: Online Unsupervised Domain Adaptation (OUDA) for person Re-Identification (Re-ID) is the task of continuously adapting a model trained on a well-annotated source domain dataset to a target domain observed as a data stream. In OUDA, person Re-ID models face two main challenges: catastrophic forgetting and domain shift. In this work, we propose a new Source-guided Similarity Preservation (S2P) framework to alleviate these two problems. Our framework is based on the extraction of a support set composed of source images that maximizes the similarity with the target data. This support set is used to identify feature similarities that must be preserved during the learning process. S2P can incorporate multiple existing UDA methods to mitigate catastrophic forgetting. Our experiments show that S2P outperforms previous state-of-the-art methods on multiple real-to-real and synthetic-to-real challenging OUDA benchmarks.


title: On the regularity of weak solution for the Oberbeck-Boussinesq equations

abstract: We prove new regularity criteria of the Prodi-Serrin type with weak Lebesgue integrability in both space and time for a viscous active chemical fluid in a bounded domain.


title: Closed-loop design for scalable performance of vehicular formations

abstract: This paper presents a novel control design for vehicular formations, which is an alternative to the conventional second-order consensus protocol. The design is motivated by the closed-loop system, which we construct as first-order systems connected in series, and is therefore called serial consensus. The serial consensus design will guarantee stability of the closed-loop system under the minimum requirement of the underlying communication graphs each containing a connected spanning tree -- something that is not true in general for the conventional consensus protocols. Here, we show that the serial consensus design also gives guarantees on the worst-case transient behavior of the formation, which are independent of the number of vehicles and the underlying graph structure. In particular this shows that the serial consensus design can be used to guarantee string stability of the formation, and is therefore suitable for directed formations. We show that it can be implemented through message passing or measurements to neighbors at most two hops away. The results are illustrated through numerical examples.


title: (Almost) Everything is a Dicke model -- Mapping non-superradiant correlated light-matter systems to the exactly solvable Dicke model

abstract: We investigate classes of interacting quantum spin systems in a single-mode cavity with a Dicke coupling, as a paradigmatic example of strongly correlated light-matter systems. Coming from the limit of weak light-matter couplings and large number of matter entities, we map the relevant low-energy sector of a broad class of models in the non-superradiant phases onto the exactly solvable Dicke model. We apply the outcomes to the Dicke-Ising model as a paradigmatic example, in agreement with results obtained by mean-field theory. We further accompany and verify our findings with finite-size calculations, using exact diagonalization and the series expansion method pcst++.


title: An Analysis of the Evolution Equations for a Generalized Bioconvective Flow

abstract: We prove results on existence and uniqueness of solutions of a system of equations modeling the evolution of a generalized bioconvective flow. The mathematical model considered in the present work describes the convective motion generated by the upward swimming of a culture of microorganisms under the influence of vertical gravitational forces, in an incompressible viscous fluid whose viscosity may depend on the concentration of microorganisms.


title: Primordial Black Holes as a dark matter candidate -- a brief overview

abstract: Historically the most popular dark matter candidates have been new elementary particles, such as Weakly Interacting Massive Particles and axions. However Primordial Black Holes (PBHs), black holes formed from overdensities in the early Universe, are another possibility. The discovery of gravitational waves from mergers of tens of Solar mass black hole binaries by LIGO-Virgo has generated a surge in interest in PBH dark matter. We overview the formation of PBHs, observational probes of their abundance, and some of the key open questions in the field.


title: Search for a new $Z'$ gauge boson via the $pp \rightarrow W^{\pm(*)} \rightarrow Z' \mu^{\pm} \nu \rightarrow \mu^{\pm}\mu^{\mp}\mu^{\pm}\nu$ process in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A search for a new $Z'$ gauge boson predicted by $L_{\mu}-L_{\tau}$ models, based on charged-current Drell-Yan production, $pp \rightarrow W^{\pm(*)} \rightarrow Z' \mu^{\pm} \nu \rightarrow \mu^{\pm}\mu^{\mp}\mu^{\pm}\nu$, is presented. The data sample used corresponds to an integrated luminosity of 140 fb$^{-1}$ of proton-proton collisions at $\sqrt{s} = 13$ TeV recorded by the ATLAS detector at the Large Hadron Collider. The search examines a final state of $3\mu$ plus large missing transverse momentum. Upper limits are set on the $Z'$ production cross-section times branching ratio in the mass range of 5-81 GeV. After combining with the previous $Z'$ search using the neutral-current Drell-Yan production with a $4\mu$ final state, the most stringent exclusion limits to date are achieved in the parameter space of the $Z'$ coupling strength and mass.


title: Statistical Agnostic Regression: a machine learning method to validate regression models

abstract: Regression analysis is a central topic in statistical modeling, aiming to estimate the relationships between a dependent variable, commonly referred to as the response variable, and one or more independent variables, i.e., explanatory variables. Linear regression is by far the most popular method for performing this task in several fields of research, such as prediction, forecasting, or causal inference. Beyond various classical methods to solve linear regression problems, such as Ordinary Least Squares, Ridge, or Lasso regressions - which are often the foundation for more advanced machine learning (ML) techniques - the latter have been successfully applied in this scenario without a formal definition of statistical significance. At most, permutation or classical analyses based on empirical measures (e.g., residuals or accuracy) have been conducted to reflect the greater ability of ML estimations for detection. In this paper, we introduce a method, named Statistical Agnostic Regression (SAR), for evaluating the statistical significance of an ML-based linear regression based on concentration inequalities of the actual risk using the analysis of the worst case. To achieve this goal, similar to the classification problem, we define a threshold to establish that there is sufficient evidence with a probability of at least 1-eta to conclude that there is a linear relationship in the population between the explanatory (feature) and the response (label) variables. Simulations in only two dimensions demonstrate the ability of the proposed agnostic test to provide a similar analysis of variance given by the classical $F$ test for the slope parameter.


title: ChildAugment: Data Augmentation Methods for Zero-Resource Children's Speaker Verification

abstract: The accuracy of modern automatic speaker verification (ASV) systems, when trained exclusively on adult data, drops substantially when applied to children's speech. The scarcity of children's speech corpora hinders fine-tuning ASV systems for children's speech. Hence, there is a timely need to explore more effective ways of reusing adults' speech data. One promising approach is to align vocal-tract parameters between adults and children through children-specific data augmentation, referred here to as ChildAugment. Specifically, we modify the formant frequencies and formant bandwidths of adult speech to emulate children's speech. The modified spectra are used to train ECAPA-TDNN (emphasized channel attention, propagation, and aggregation in time-delay neural network) recognizer for children. We compare ChildAugment against various state-of-the-art data augmentation techniques for children's ASV. We also extensively compare different scoring methods, including cosine scoring, PLDA (probabilistic linear discriminant analysis), and NPLDA (neural PLDA). We also propose a low-complexity weighted cosine score for extremely low-resource children ASV. Our findings on the CSLU kids corpus indicate that ChildAugment holds promise as a simple, acoustics-motivated approach, for improving state-of-the-art deep learning based ASV for children. We achieve up to 12.45% (boys) and 11.96% (girls) relative improvement over the baseline.


title: Item-side Fairness of Large Language Model-based Recommendation System

abstract: Recommendation systems for Web content distribution intricately connect to the information access and exposure opportunities for vulnerable populations. The emergence of Large Language Models-based Recommendation System (LRS) may introduce additional societal challenges to recommendation systems due to the inherent biases in Large Language Models (LLMs). From the perspective of item-side fairness, there remains a lack of comprehensive investigation into the item-side fairness of LRS given the unique characteristics of LRS compared to conventional recommendation systems. To bridge this gap, this study examines the property of LRS with respect to item-side fairness and reveals the influencing factors of both historical users' interactions and inherent semantic biases of LLMs, shedding light on the need to extend conventional item-side fairness methods for LRS. Towards this goal, we develop a concise and effective framework called IFairLRS to enhance the item-side fairness of an LRS. IFairLRS covers the main stages of building an LRS with specifically adapted strategies to calibrate the recommendations of LRS. We utilize IFairLRS to fine-tune LLaMA, a representative LLM, on \textit{MovieLens} and \textit{Steam} datasets, and observe significant item-side fairness improvements. The code can be found in https://github.com/JiangM-C/IFairLRS.git.


title: Label-efficient Multi-organ Segmentation Method with Diffusion Model

abstract: Accurate segmentation of multiple organs in Computed Tomography (CT) images plays a vital role in computer-aided diagnosis systems. Various supervised-learning approaches have been proposed recently. However, these methods heavily depend on a large amount of high-quality labeled data, which is expensive to obtain in practice. In this study, we present a label-efficient learning approach using a pre-trained diffusion model for multi-organ segmentation tasks in CT images. First, a denoising diffusion model was trained using unlabeled CT data, generating additional two-dimensional (2D) CT images. Then the pre-trained denoising diffusion network was transferred to the downstream multi-organ segmentation task, effectively creating a semi-supervised learning model that requires only a small amount of labeled data. Furthermore, linear classification and fine-tuning decoder strategies were employed to enhance the network's segmentation performance. Our generative model at 256x256 resolution achieves impressive performance in terms of Fr\'echet inception distance, spatial Fr\'echet inception distance, and F1-score, with values of 11.32, 46.93, and 73.1\%, respectively. These results affirm the diffusion model's ability to generate diverse and realistic 2D CT images. Additionally, our method achieves competitive multi-organ segmentation performance compared to state-of-the-art methods on the FLARE 2022 dataset, particularly in limited labeled data scenarios. Remarkably, even with only 1\% and 10\% labeled data, our method achieves Dice similarity coefficients (DSCs) of 71.56\% and 78.51\% after fine-tuning, respectively. The method achieves a DSC score of 51.81\% using just four labeled CT scans. These results demonstrate the efficacy of our approach in overcoming the limitations of supervised learning heavily reliant on large-scale labeled data.


title: How to identify earth pressures on in-service tunnel linings: A Bayesian learning perspective

abstract: The identification of earth pressures acting on in-service transportation tunnel linings is essential for their health monitoring and performance prediction, especially for those exhibiting poor structural performance. Since pressure gauges incur substantial costs, the inversion of pressures based on easily observed structural responses, such as deformations, is desirable. The inherent challenge in this inverse problem lies in the non-uniqueness of solutions, which arises from the fact that various pressures can yield structural responses fitting equally well with the observed data. However, existing approaches for pressure inversion predominantly rely on a deterministic framework, often neglecting a detailed discussion on this non-uniqueness. In addressing this gap, this study introduces a Bayesian approach. The proposed statistical framework enables the quantification of uncertainty induced by non-uniqueness in inversion results. The analysis identifies the uniform component in distributed pressures as the primary source of non-uniqueness. The mitigation of solution non-uniqueness can be achieved by increasing the quantity of deformation data or incorporating an observation of internal normal force in a tunnel lining -- the latter proving to be notably more effective. The practical application in a numerical case demonstrates the effectiveness of this approach and the associated findings. In addition, our investigation recommends maintaining deformation measurement accuracy within the range of [-1, 1] mm to ensure satisfactory outcomes. Finally, deficiencies and potential future extensions of this approach are discussed.


title: BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators

abstract: Extremely large image generators offer significant transformative potential across diverse sectors. It allows users to design specific prompts to generate realistic images through some black-box APIs. However, some studies reveal that image generators are notably susceptible to attacks and generate Not Suitable For Work (NSFW) contents by manually designed toxin texts, especially imperceptible to human observers. We urgently need a multitude of universal and transferable prompts to improve the safety of image generators, especially black-box-released APIs. Nevertheless, they are constrained by labor-intensive design processes and heavily reliant on the quality of the given instructions. To achieve this, we introduce a black-box stealthy prompt attack (BSPA) that adopts a retriever to simulate attacks from API users. It can effectively harness filter scores to tune the retrieval space of sensitive words for matching the input prompts, thereby crafting stealthy prompts tailored for image generators. Significantly, this approach is model-agnostic and requires no internal access to the model's features, ensuring its applicability to a wide range of image generators. Building on BSPA, we have constructed an automated prompt tool and a comprehensive prompt attack dataset (NSFWeval). Extensive experiments demonstrate that BSPA effectively explores the security vulnerabilities in a variety of state-of-the-art available black-box models, including Stable Diffusion XL, Midjourney, and DALL-E 2/3. Furthermore, we develop a resilient text filter and offer targeted recommendations to ensure the security of image generators against prompt attacks in the future.


title: Global Rotation of Skyrmion Bags under Vertical Microwave Fields

abstract: Magnetic skyrmion bags are composite topological spin textures with arbitrary topological charges. Here, we computationally study the transient rotational motion of skyrmion bags, which is characterized by a global rotation of the inner skyrmions around the central point. Distinct from conventional rotational modes found in skyrmions, the observed rotation is a forced motion associated with the breathing mode induced solely by vertical microwave fields. The driving force behind this rotation originates from the interactions between outer and inner skyrmions, with the angular velocity determined by the phase difference resulting from their asynchronous breathing behaviors. It is also found that skyrmion bags with larger skyrmion numbers are more conducive to the occurrence of the rotation. Our results are useful for understanding the cluster dynamics of complex topological spin textures driven by dynamic fields.


title: ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition

abstract: Self-attention is an essential component of large language models(LLMs) but a significant source of inference latency for long sequences. In multi-tenant LLMs serving scenarios, the compute and memory operation cost of self-attention can be optimized by using the probability that multiple LLM requests have shared system prompts in prefixes. In this paper, we introduce ChunkAttention, a prefix-aware self-attention module that can detect matching prompt prefixes across multiple requests and share their key/value tensors in memory at runtime to improve the memory utilization of KV cache. This is achieved by breaking monolithic key/value tensors into smaller chunks and structuring them into the auxiliary prefix tree. Consequently, on top of the prefix-tree based KV cache, we design an efficient self-attention kernel, where a two-phase partition algorithm is implemented to improve the data locality during self-attention computation in the presence of shared system prompts. Experiments show that ChunkAttention can speed up the self-attention kernel by 3.2-4.8$\times$ compared to the start-of-the-art implementation, with the length of the system prompt ranging from 1024 to 4096.


title: Weak Reproductive Solutions for a Convection-Diffusion Model Describing a Binary Alloy Solidification Processes

abstract: We study the existence of reproductive weak solutions for a system of equations describing a solidification process of a binary alloy confined into a bounded and regular domain in $\mathbb{R}^3$, having mixed boundary conditions.


title: Low-Latency Upstream Scheduling in Multi-Tenant, SLA Compliant TWDM PON

abstract: We present a multi-tenant multi-wavelength upstream transmission scheme for virtualised PONs, enabling compliance with latency-oriented Service Level Agreements (SLAs). Our analysis highlights an important trade-off between single-channel vs. multi-channel PONs, depending on ONUs tuning time.


title: New scattered subspaces in higher dimensions

abstract: Over the past few decades, there has been extensive research on scattered subspaces, partly because of their link to MRD codes. These subspaces can be characterized using linearized polynomials over finite fields. Within this context, scattered sequences extend the concept of scattered polynomials and can be viewed as geometric equivalents of exceptional MRD codes. Up to now, only scattered sequences of orders one and two have been developed. However, this paper presents an infinite series of exceptional scattered sequences of any order beyond two which correspond to scattered subspaces that cannot be obtained as direct sum of scattered subspaces in smaller dimensions. The paper also addresses equivalence concerns within this framework.


title: Distinguishing fission-like events from deep-inelastic collisions

abstract: We propose two functions to distinguish fission-like events from quasi-elastic (QE) scattering and deep inelastic collisions (DIC), for a better analysis of the measured mass-total kinetic energy distributions of binary fragments formed in fusion-fission reactions. We note that the ratio of capture to DIC events evidently decreases with the decreasing of the depth of the capture pocket predicted from the Skyrme energy density functional, with which the capture pocket could be extracted from the measured mass-energy distributions. Together with the improved quantum molecular dynamics simulations, in which the typical contact time of the reaction partners is smaller than 200 fm/c for QE and is larger than 600 fm/c for fission-like events, we find that the ratio of capture to touching cross section systematically increases with the pocket depth.


title: Attosecond vortex pulse trains

abstract: The landscape of ultrafast structured light pulses has recently evolved driven by the capability of high-order harmonic generation (HHG) to up-convert orbital angular momentum (OAM) from the infrared to the extreme-ultraviolet (EUV) spectral regime. Accordingly, HHG has been proven to produce EUV vortex pulses at the femtosecond timescale. Here we demonstrate the generation of attosecond vortex pulse trains, i.e. a succession of attosecond pulses with a helical wavefront, resulting from the synthesis of a comb of EUV high-order harmonics with the same OAM. By driving HHG with a polarization tilt-angle fork grating, two spatially separated circularly polarized high-order harmonic beams with order-independent OAM are created. Our work opens the route towards attosecond-resolved OAM light-matter interactions.


title: Ballistic vs. diffusive transport in metals

abstract: Using the Boltzmann transport model, we show that, somewhat unintuitively, ballistic transport of electrons in metals is weaker than diffusive transport. This happens because the femtosecond-scale collision rates of the non-thermal electrons makes their mean-free path negligible. Our predictions are correlated with various photoluminescence and nonlinear optics experimental examples both for Continuous Wave (CW) and pulsed illumination, and open the way to easy modelling of the non-thermal electron distributions in metal nanostructures of arbitrary complexity.


title: Fixed Random Classifier Rearrangement for Continual Learning

abstract: With the explosive growth of data, continual learning capability is increasingly important for neural networks. Due to catastrophic forgetting, neural networks inevitably forget the knowledge of old tasks after learning new ones. In visual classification scenario, a common practice of alleviating the forgetting is to constrain the backbone. However, the impact of classifiers is underestimated. In this paper, we analyze the variation of model predictions in sequential binary classification tasks and find that the norm of the equivalent one-class classifiers significantly affects the forgetting level. Based on this conclusion, we propose a two-stage continual learning algorithm named Fixed Random Classifier Rearrangement (FRCR). In first stage, FRCR replaces the learnable classifiers with fixed random classifiers, constraining the norm of the equivalent one-class classifiers without affecting the performance of the network. In second stage, FRCR rearranges the entries of new classifiers to implicitly reduce the drift of old latent representations. The experimental results on multiple datasets show that FRCR significantly mitigates the model forgetting; subsequent experimental analyses further validate the effectiveness of the algorithm.


title: Convolutions and Mixtures of Gamma, Stable and Mittag-Leffler Distributions

abstract: This paper uses convolutions of the gamma density and the one-sided stable density to construct higher level densities. The approach is applied to constructing a 4-parameter Mittag-Leffler density, whose Laplace transform is a corresponding Mittag-Leffler function, which is completely monotone (CM) by construction. Laplace transforms of mixtures of the stable densities with respect to the 4-parameter Mittag-Leffler distribution are compositions of the Mittag-Leffler functions with Bernstein functions, thereby generating a rich family of CM variants of the base CM Mittag-Leffler functions, including known instances as special cases.


title: Systematic effects on a Compton polarimeter at the focus of an X-ray mirror

abstract: XL-Calibur is a balloon-borne Compton polarimeter for X-rays in the $\sim$15-80 keV range. Using an X-ray mirror with a 12 m focal length for collecting photons onto a beryllium scattering rod surrounded by CZT detectors, a minimum-detectable polarization as low as $\sim$3% is expected during a 24-hour on-target observation of a 1 Crab source at 45$^{\circ}$ elevation. Systematic effects alter the reconstructed polarization as the mirror focal spot moves across the beryllium scatterer, due to pointing offsets, mechanical misalignment or deformation of the carbon-fiber truss supporting the mirror and the polarimeter. Unaddressed, this can give rise to a spurious polarization signal for an unpolarized flux, or a change in reconstructed polarization fraction and angle for a polarized flux. Using bench-marked Monte-Carlo simulations and an accurate mirror point-spread function characterized at synchrotron beam-lines, systematic effects are quantified, and mitigation strategies discussed. By recalculating the scattering site for a shifted beam, systematic errors can be reduced from several tens of percent to the few-percent level for any shift within the scattering element. The treatment of these systematic effects will be important for any polarimetric instrument where a focused X-ray beam is impinging on a scattering element surrounded by counting detectors.


title: Open Energy Services -- Forecasting and Optimization as a Service for Energy Management Applications at Scale

abstract: Energy management, in sense of computing optimized operation schedules for devices, will likely play a vital role in future carbon neutral energy systems, as it allows unlocking energy efficiency and flexibility potentials. However, energy management systems need to be applied at large scales to realize the desired effect, which clearly requires minimization of costs for setup and operation of the individual applications. In order to push the latter forward, we promote an approach to split the complex optimization algorithms employed by energy management systems into standardized components, which can be provided as a service with marginal costs at scale. This work is centered around the systematic design of a framework supporting the efficient implementation and operation of such forecasting and optimization services. Furthermore, it describes the implementation of the design concept which we release under the name \emph{Energy Service Generics} as a free and open source repository. Finally, this paper marks the starting point of the \emph{Open Energy Services} community, our effort to continuously push the development and operation of services for energy management applications at scale, for which we invite researchers and practitioners to participate.


title: Which Model to Transfer? A Survey on Transferability Estimation

abstract: Transfer learning methods endeavor to leverage relevant knowledge from existing source pre-trained models or datasets to solve downstream target tasks. With the increase in the scale and quantity of available pre-trained models nowadays, it becomes critical to assess in advance whether they are suitable for a specific target task. Model transferability estimation is an emerging and growing area of interest, aiming to propose a metric to quantify this suitability without training them individually, which is computationally prohibitive. Despite extensive recent advances already devoted to this area, they have custom terminological definitions and experimental settings. In this survey, we present the first review of existing advances in this area and categorize them into two separate realms: source-free model transferability estimation and source-dependent model transferability estimation. Each category is systematically defined, accompanied by a comprehensive taxonomy. Besides, we address challenges and outline future research directions, intending to provide a comprehensive guide to aid researchers and practitioners.


title: Classification of compact radio sources in the Galactic plane with supervised machine learning

abstract: Generation of science-ready data from processed data products is one of the major challenges in next-generation radio continuum surveys with the Square Kilometre Array (SKA) and its precursors, due to the expected data volume and the need to achieve a high degree of automated processing. Source extraction, characterization, and classification are the major stages involved in this process. In this work we focus on the classification of compact radio sources in the Galactic plane using both radio and infrared images as inputs. To this aim, we produced a curated dataset of ~20,000 images of compact sources of different astronomical classes, obtained from past radio and infrared surveys, and novel radio data from pilot surveys carried out with the Australian SKA Pathfinder (ASKAP). Radio spectral index information was also obtained for a subset of the data. We then trained two different classifiers on the produced dataset. The first model uses gradient-boosted decision trees and is trained on a set of pre-computed features derived from the data, which include radio-infrared colour indices and the radio spectral index. The second model is trained directly on multi-channel images, employing convolutional neural networks. Using a completely supervised procedure, we obtained a high classification accuracy (F1-score>90%) for separating Galactic objects from the extragalactic background. Individual class discrimination performances, ranging from 60% to 75%, increased by 10% when adding far-infrared and spectral index information, with extragalactic objects, PNe and HII regions identified with higher accuracies. The implemented tools and trained models were publicly released, and made available to the radioastronomical community for future application on new radio data.


title: On the composable security of weak coin flipping

abstract: Weak coin flipping is a cryptographic primitive in which two mutually distrustful parties generate a shared random bit to agree on a winner via remote communication. While a stand-alone secure weak coin flipping protocol can be constructed from noiseless communication channels, its composability has not been explored. In this work, we demonstrate that no weak coin flipping protocol can be abstracted into a black box resource with composable security. Despite this, we also establish the overall stand-alone security of weak coin flipping protocols under sequential composition.


title: Exact results for non-Newtonian transport properties in sheared granular suspensions: inelastic Maxwell models and BGK-type kinetic model

abstract: The Boltzmann kinetic equation for dilute granular suspensions under simple (or uniform) shear flow (USF) is considered to determine the non-Newtonian transport properties of the system. In contrast to previous attempts based on a coarse-grained description, our suspension model accounts for the real collisions between grains and particles of the surrounding molecular gas. The latter is modeled as a bath (or thermostat) of elastic hard spheres at a given temperature. Two independent but complementary approaches are followed to reach exact expressions for the rheological properties. First, the Boltzmann equation for the so-called inelastic Maxwell models (IMM) is considered. The fact that the collision rate of IMM is independent of the relative velocity of the colliding spheres allows us to exactly compute the collisional moments of the Boltzmann operator without the knowledge of the distribution function. Thanks to this property the transport properties of the sheared granular suspension can be \emph{exactly} determined. As a second approach, a Bhatnagar--Gross--Krook (BGK)-type kinetic model adapted to granular suspensions is solved to compute the velocity moments and the velocity distribution function of the system. The theoretical results show in general a good agreement with the approximate analytical results derived for inelastic hard spheres (IHS) by means of Grad's moment method and with computer simulations performed in the Brownian limiting case ($m/m_g\to \infty$, where $m_g$ and $m$ are the masses of the particles of the molecular and granular gases, respectively). In addition, as expected the IMM and BGK results show that the temperature and non-Newtonian viscosity exhibit and $S$ shape in a plane of stress-strain rate (discontinuous shear thickening, DST). The DST effect becomes more pronounced as the mass ratio $m/m_g$ increases.


title: Multi-Agent Collaboration Framework for Recommender Systems

abstract: LLM-based agents have gained considerable attention for their decision-making skills and ability to handle complex tasks. Recognizing the current gap in leveraging agent capabilities for multi-agent collaboration in recommendation systems, we introduce MACRec, a novel framework designed to enhance recommendation systems through multi-agent collaboration. Unlike existing work on using agents for user/item simulation, we aim to deploy multi-agents to tackle recommendation tasks directly. In our framework, recommendation tasks are addressed through the collaborative efforts of various specialized agents, including Manager, User/Item Analyst, Reflector, Searcher, and Task Interpreter, with different working flows. Furthermore, we provide application examples of how developers can easily use MACRec on various recommendation tasks, including rating prediction, sequential recommendation, conversational recommendation, and explanation generation of recommendation results. The framework and demonstration video are publicly available at https://github.com/wzf2000/MACRec.


title: Font Impression Estimation in the Wild

abstract: This paper addresses the challenging task of estimating font impressions from real font images. We use a font dataset with annotation about font impressions and a convolutional neural network (CNN) framework for this task. However, impressions attached to individual fonts are often missing and noisy because of the subjective characteristic of font impression annotation. To realize stable impression estimation even with such a dataset, we propose an exemplar-based impression estimation approach, which relies on a strategy of ensembling impressions of exemplar fonts that are similar to the input image. In addition, we train CNN with synthetic font images that mimic scanned word images so that CNN estimates impressions of font images in the wild. We evaluate the basic performance of the proposed estimation method quantitatively and qualitatively. Then, we conduct a correlation analysis between book genres and font impressions on real book cover images; it is important to note that this analysis is only possible with our impression estimation method. The analysis reveals various trends in the correlation between them - this fact supports a hypothesis that book cover designers carefully choose a font for a book cover considering the impression given by the font.


title: Unsupervised Domain Adaptation for Brain Vessel Segmentation through Transwarp Contrastive Learning

abstract: Unsupervised domain adaptation (UDA) aims to align the labelled source distribution with the unlabelled target distribution to obtain domain-invariant predictive models. Since cross-modality medical data exhibit significant intra and inter-domain shifts and most are unlabelled, UDA is more important while challenging in medical image analysis. This paper proposes a simple yet potent contrastive learning framework for UDA to narrow the inter-domain gap between labelled source and unlabelled target distribution. Our method is validated on cerebral vessel datasets. Experimental results show that our approach can learn latent features from labelled 3DRA modality data and improve vessel segmentation performance in unlabelled MRA modality data.


title: GPT-HateCheck: Can LLMs Write Better Functional Tests for Hate Speech Detection?

abstract: Online hate detection suffers from biases incurred in data sampling, annotation, and model pre-training. Therefore, measuring the averaged performance over all examples in held-out test data is inadequate. Instead, we must identify specific model weaknesses and be informed when it is more likely to fail. A recent proposal in this direction is HateCheck, a suite for testing fine-grained model functionalities on synthesized data generated using templates of the kind "You are just a [slur] to me." However, despite enabling more detailed diagnostic insights, the HateCheck test cases are often generic and have simplistic sentence structures that do not match the real-world data. To address this limitation, we propose GPT-HateCheck, a framework to generate more diverse and realistic functional tests from scratch by instructing large language models (LLMs). We employ an additional natural language inference (NLI) model to verify the generations. Crowd-sourced annotation demonstrates that the generated test cases are of high quality. Using the new functional tests, we can uncover model weaknesses that would be overlooked using the original HateCheck dataset.


title: GS-EMA: Integrating Gradient Surgery Exponential Moving Average with Boundary-Aware Contrastive Learning for Enhanced Domain Generalization in Aneurysm Segmentation

abstract: The automated segmentation of cerebral aneurysms is pivotal for accurate diagnosis and treatment planning. Confronted with significant domain shifts and class imbalance in 3D Rotational Angiography (3DRA) data from various medical institutions, the task becomes challenging. These shifts include differences in image appearance, intensity distribution, resolution, and aneurysm size, all of which complicate the segmentation process. To tackle these issues, we propose a novel domain generalization strategy that employs gradient surgery exponential moving average (GS-EMA) optimization technique coupled with boundary-aware contrastive learning (BACL). Our approach is distinct in its ability to adapt to new, unseen domains by learning domain-invariant features, thereby improving the robustness and accuracy of aneurysm segmentation across diverse clinical datasets. The results demonstrate that our proposed approach can extract more domain-invariant features, minimizing over-segmentation and capturing more complete aneurysm structures.


title: AGN feedback in isolated galaxies with a SMUGGLE multiphase ISM

abstract: Feedback from active galactic nuclei (AGN) can strongly impact the host galaxies by driving high-velocity winds that impart substantial energy and momentum to the interstellar medium (ISM). In this work, we study the impact of these winds in isolated galaxies using high-resolution hydrodynamics simulations. Our simulations use the explicit ISM and stellar evolution model called Stars and MUltiphase Gas in GaLaxiEs (SMUGGLE). Additionally, using a super-Lagrangian refinement scheme, we resolve AGN feedback coupling to the ISM at $\sim$10-100 pc scales. We find that AGN feedback efficiently regulates the growth of SMBHs. However, its effect on star formation and outflows depends strongly on the relative strengths of AGN vs local stellar feedback and the geometrical structure of the gas disk. When the energy injected by AGN is subdominant to that of stellar feedback, there are no significant changes in the star formation rates or mass outflow rates of the host galaxy. Conversely, when the energy budget is dominated by the AGN, we see a significant decline in the star formation rates accompanied by an increase in outflows. Galaxies with thin gas disks like the Milky Way allow feedback to escape easily into the polar directions without doing much work on the ISM. In contrast, galaxies with thick and diffuse gas disks confine the initial expansion of the feedback bubble within the disk, resulting in more work done on the ISM. Phase space analysis indicates that outflows primarily comprise hot and diffuse gas, with a lack of cold and dense gas.


title: Catalog of Stars with Solar-Type Activity -- CSSTA

abstract: A new version of CSSTA catalog of the lower main-sequence stars with solar-type activity was presented. It comprises 314618 objects, and the database that is realized on its basis is a developing project that contains hyperlinks to the original photometric and spectral observations.


title: On the existence of unbiased resilient estimators in discrete quantum systems

abstract: Cram\'er-Rao constitutes a crucial lower bound for the mean squared error of an estimator in frequentist parameter estimation, albeit paradoxically demanding highly accurate prior knowledge of the parameter to be estimated. Indeed, this information is needed to construct the optimal unbiased estimator, which is highly dependent on the parameter. Conversely, Bhattacharyya bounds result in a more resilient estimation about prior accuracy by imposing additional constraints on the estimator. Initially, we conduct a quantitative comparison of the performance between Cram\'er-Rao and Bhattacharyya bounds when faced with less-than-ideal prior knowledge of the parameter. Furthermore, we demonstrate that the $n^{th}$order classical and quantum Bhattacharyya bounds cannot be computed -- given the absence of estimators satisfying the constraints -- under specific conditions tied to the dimension $m$ of the discrete system. Intriguingly, for a system with the same dimension $m$, the maximum non-trivial order $n$ is $m-1$ in the classical case, while in the quantum realm, it extends to $m(m+1)/2-1$. Consequently, for a given system dimension, one can construct estimators in quantum systems that exhibit increased robustness to prior ignorance.


title: Safety-Conscious Pushing on Diverse Oriented Surfaces with Underactuated Aerial Vehicles

abstract: Pushing tasks performed by aerial manipulators can be used for contact-based industrial inspections. Underactuated aerial vehicles are widely employed in aerial manipulation due to their widespread availability and relatively low cost. Industrial infrastructures often consist of diverse oriented work surfaces. When interacting with such surfaces, the coupled gravity compensation and interaction force generation of underactuated aerial vehicles can present the potential challenge of near-saturation operations. The blind utilization of these platforms for such tasks can lead to instability and accidents, creating unsafe operating conditions and potentially damaging the platform. In order to ensure safe pushing on these surfaces while managing platform saturation, this work establishes a safety assessment process. This process involves the prediction of the saturation level of each actuator during pushing across variable surface orientations. Furthermore, the assessment results are used to plan and execute physical experiments, ensuring safe operations and preventing platform damage.


title: Turbulent flows over porous and rough substrates

abstract: Turbulent flows over porous substrates are studied via a systematic exploration of the dependence of the flow properties on the substrate parameters, including permeability $K$, grain size $L$, and depth $h$. The study uses direct numerical simulations for staggered-cube substrates with $L^+\approx10$ - $50$, $\sqrt{K}/L\approx0.01$ - $0.25$, and depths from $h=O(L)$ to $h\gg L$, ranging from typical impermeable rough surfaces to deep porous substrates. The results indicate that the permeability has significantly greater relevance than the grain size for the properties of the overlying flow, including the mean-flow slip and the shear across the interface, the drag increase relative to smooth-wall flow, and the statistics and spectra of the overlying turbulence, whereas the direct effect of grain size is only noticeable near the interface as grain-coherent flow fluctuations. The substrate depth also has a significant effect, with shallower substrates suppressing the effective transpiration at the interface excited by pressure fluctuations. We propose an empirical `equivalent permeability' $K_{eq}^t$, that incorporates this effect and scales well the overlying turbulence for substrates with different depths. Based on this, we propose a conceptual $h^+$-$\sqrt{K^+}$ regime diagram where turbulence transitions smoothly from that over impermeable rough surfaces with $h=O(L)$ to that over deep porous substrates with $h^+\gtrsim50$, with the latter limit determined by the typical lengthscale of the overlying pressure fluctuations.


title: Affleck-Dine Dirac Leptogenesis

abstract: We present a minimal framework that realises successful Dirac Leptogenesis through the Affleck-Dine mechanism. A single right-handed neutrino and a neutrinophillic Higgs doublet are introduced to the Standard Model, which couple via a Yukawa interaction. The inflationary setting is induced by a combination of the two Higgs doublets, with their global symmetry violating interactions leading to a net charge generation via the Affleck-Dine mechanism. This simple Standard Model extension exhibits a unique and connected set of phenomenological implications including the resultant baryon asymmetry, inflationary predictions, cosmological implications, relic right-handed neutrinos, and its low energy phenomenology, while also being able to be embedded in various neutrino mass generating mechanisms.


title: Artificial Bee Colony optimization of Deep Convolutional Neural Networks in the context of Biomedical Imaging

abstract: Most efforts in Computer Vision focus on natural images or artwork, which differ significantly both in size and contents from the kind of data biomedical image processing deals with. Thus, Transfer Learning models often prove themselves suboptimal for these tasks, even after manual finetuning. The development of architectures from scratch is oftentimes unfeasible due to the vastness of the hyperparameter space and a shortage of time, computational resources and Deep Learning experts in most biomedical research laboratories. An alternative to manually defining the models is the use of Neuroevolution, which employs metaheuristic techniques to optimize Deep Learning architectures. However, many algorithms proposed in the neuroevolutive literature are either too unreliable or limited to a small, predefined region of the hyperparameter space. To overcome these shortcomings, we propose the Chimera Algorithm, a novel, hybrid neuroevolutive algorithm that integrates the Artificial Bee Colony Algorithm with Evolutionary Computation tools to generate models from scratch, as well as to refine a given previous architecture to better fit the task at hand. The Chimera Algorithm has been validated with two datasets of natural and medical images, producing models that surpassed the performance of those coming from Transfer Learning.


title: A Bargaining-based Approach for Feature Trading in Vertical Federated Learning

abstract: Vertical Federated Learning (VFL) has emerged as a popular machine learning paradigm, enabling model training across the data and the task parties with different features about the same user set while preserving data privacy. In production environment, VFL usually involves one task party and one data party. Fair and economically efficient feature trading is crucial to the commercialization of VFL, where the task party is considered as the data consumer who buys the data party's features. However, current VFL feature trading practices often price the data party's data as a whole and assume transactions occur prior to the performing VFL. Neglecting the performance gains resulting from traded features may lead to underpayment and overpayment issues. In this study, we propose a bargaining-based feature trading approach in VFL to encourage economically efficient transactions. Our model incorporates performance gain-based pricing, taking into account the revenue-based optimization objectives of both parties. We analyze the proposed bargaining model under perfect and imperfect performance information settings, proving the existence of an equilibrium that optimizes the parties' objectives. Moreover, we develop performance gain estimation-based bargaining strategies for imperfect performance information scenarios and discuss potential security issues and solutions. Experiments on three real-world datasets demonstrate the effectiveness of the proposed bargaining model.


title: Chitchat as Interference: Adding User Backstories to Task-Oriented Dialogues

abstract: During task-oriented dialogues (TODs), human users naturally introduce chitchat that is beyond the immediate scope of the task, interfering with the flow of the conversation. To address this issue without the need for expensive manual data creation, we use few-shot prompting with Llama-2-70B to enhance the MultiWOZ dataset with user backstories, a typical example of chitchat interference in TODs. We assess the impact of this addition by testing two models: one trained solely on TODs and another trained on TODs with a preliminary chitchat interaction. Our analysis demonstrates that our enhanced dataset poses a challenge for these systems. Moreover, we demonstrate that our dataset can be effectively used for training purposes, enabling a system to consistently acknowledge the user's backstory while also successfully moving the task forward in the same turn, as confirmed by human evaluation. These findings highlight the benefits of generating novel chitchat-TOD scenarios to test TOD systems more thoroughly and improve their resilience to natural user interferences


title: Interferometric microscale measurement of refractive index at VIS and IR wavelengths

abstract: Determination of refractive index of micro-disks of a calcinated ($1100^\circ$C in air) photo-resist SZ2080$^\mathrm{TM}$ was carried out using transmission and reflection spectroscopy. Interference fringes at specific wavenumbers/wavelengths were selected for determination of the optical thickness, hence, the refractive index when the thickness of micro-disks was measured by scanning electron microscopy (SEM). Refractive index of disks of $\sim 6\pm 1~\mu$m thickness were determined at visible and IR (2.5-13~$\mu$m) spectral ranges and where $2.2\pm 0.2$ at visible and IR wavelengths. Peculiarities of optical characterisation of micro-optical structures are discussed in view of possible uncertainties in the definition of geometric parameters, shape and mass density redistribution.


title: Optimal regularity for all time for entropy solutions of conservation laws in $BV^s$

abstract: This paper deals with the optimal regularity for entropy solutions of conservation laws. For this purpose, we use two key ingredients: (a) fine structure of entropy solutions and (b) fractional $BV$ spaces. We show that optimality of the regularizing effect for the initial value problem from $L^\infty$ to fractional Sobolev space and fractional $BV$ spaces is valid for all time. Previously, such optimality was proven only for a finite time, before the nonlinear interaction of waves. Here for some well-chosen examples, the sharp regularity is obtained after the interaction of waves. Moreover , we prove sharp smoothing in $BV^s$ for a convex scalar conservation law with a linear source term. Next, we provide an upper bound of the maximal smoothing effect for nonlinear scalar multi-dimensional conservation laws and some hyperbolic systems in one or multi-dimension.