title: Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems

abstract: We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the polyhedral setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly dimension-independent convergence rates for the expected duality gap, a type of guarantee that was known before only for bilinear objectives. For convex-concave and first-order-smooth stochastic objectives, our algorithms attain a rate of $\sqrt{\log(d)/n} + (\log(d)^{3/2}/[n\varepsilon])^{1/3}$, where $d$ is the dimension of the problem and $n$ the dataset size. Under an additional second-order-smoothness assumption, we improve the rate on the expected gap to $\sqrt{\log(d)/n} + (\log(d)^{3/2}/[n\varepsilon])^{2/5}$. Under this additional assumption, we also show, by using bias-reduced gradient estimators, that the duality gap is bounded by $\log(d)/\sqrt{n} + \log(d)/[n\varepsilon]^{1/2}$ with constant success probability. This result provides evidence of the near-optimality of the approach. Finally, we show that combining our methods with acceleration techniques from online learning leads to the first algorithm for DP Stochastic Convex Optimization in the polyhedral setting that is not based on Frank-Wolfe methods. For convex and first-order-smooth stochastic objectives, our algorithms attain an excess risk of $\sqrt{\log(d)/n} + \log(d)^{7/10}/[n\varepsilon]^{2/5}$, and when additionally assuming second-order-smoothness, we improve the rate to $\sqrt{\log(d)/n} + \log(d)/\sqrt{n\varepsilon}$. Instrumental to all of these results are various extensions of the classical Maurey Sparsification Lemma, which may be of independent interest.


title: Scientific machine learning for closure models in multiscale problems: a review

abstract: Closure problems are omnipresent when simulating multiscale systems, where some quantities and processes cannot be fully prescribed despite their effects on the simulation's accuracy. Recently, scientific machine learning approaches have been proposed as a way to tackle the closure problem, combining traditional (physics-based) modeling with data-driven (machine-learned) techniques, typically through enriching differential equations with neural networks. This paper reviews the different reduced model forms, distinguished by the degree to which they include known physics, and the different objectives of a priori and a posteriori learning. The importance of adhering to physical laws (such as symmetries and conservation laws) in choosing the reduced model form and choosing the learning method is discussed. The effect of spatial and temporal discretization and recent trends toward discretization-invariant models are reviewed. In addition, we make the connections between closure problems and several other research disciplines: inverse problems, Mori-Zwanzig theory, and multi-fidelity methods. In conclusion, much progress has been made with scientific machine learning approaches for solving closure problems, but many challenges remain. In particular, the generalizability and interpretability of learned models is a major issue that needs to be addressed further.


title: DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting

abstract: The ever-increasing sensor service, though opening a precious path and providing a deluge of earth system data for deep-learning-oriented earth science, sadly introduce a daunting obstacle to their industrial level deployment. Concretely, earth science systems rely heavily on the extensive deployment of sensors, however, the data collection from sensors is constrained by complex geographical and social factors, making it challenging to achieve comprehensive coverage and uniform deployment. To alleviate the obstacle, traditional approaches to sensor deployment utilize specific algorithms to design and deploy sensors. These methods dynamically adjust the activation times of sensors to optimize the detection process across each sub-region. Regrettably, formulating an activation strategy generally based on historical observations and geographic characteristics, which make the methods and resultant models were neither simple nor practical. Worse still, the complex technical design may ultimately lead to a model with weak generalizability. In this paper, we introduce for the first time the concept of spatio-temporal data dynamic sparse training and are committed to adaptively, dynamically filtering important sensor distributions. To our knowledge, this is the first proposal (termed DynST) of an industry-level deployment optimization concept at the data level. However, due to the existence of the temporal dimension, pruning of spatio-temporal data may lead to conflicts at different timestamps. To achieve this goal, we employ dynamic merge technology, along with ingenious dimensional mapping to mitigate potential impacts caused by the temporal aspect. During the training process, DynST utilize iterative pruning and sparse training, repeatedly identifying and dynamically removing sensor perception areas that contribute the least to future predictions.


title: Photon-exciton strong coupling induced by topological edge state

abstract: Strong coupling between single quantum emitter and dielectric nanoparticle has not been achieved due to large scattering loss of dielectric nanoparticle. Here we propose strong photon-exciton coupling mechanism under topological protection. In hybrid two-dimensional topological photonic crystal structure containing gap dielectric nanoantenna, owing to the robustness of the topological pattern, the photons originally scattered to the surrounding area can be guided into the edge-state channel, so the linewidth of nanoantenna is greatly narrowed. Simultaneously, the stronger local field in the nanoantenna gap provides a relatively large coupling coefficient. Therefore, strong coupling condition is achieved. Our results demonstrate the potential of dielectric structures as a platform for studying cavity quantum electrodynamics in a single quantum level.


title: Microscopic parametrization of the near threshold oscillations of the nucleon time-like effective electromagnetic form factors

abstract: We present an analysis of the recent near threshold BESIII data for the nucleon time-like effective form factors. The damped oscillation emerging from the subtraction of the dipole formula is treated in non-perturbative-QCD, making use of the light cone distribution amplitudes expansion. Non-perturbative effects are accounted for by considering Q2-dependent coefficients in such expansions, whose free parameters are determined by fitting to the proton and neutron data. Possible implications and future analysis have been discussed.


title: A Miniaturized Device for Ultrafast On-demand Drug Release based on a Gigahertz Ultrasonic Resonator

abstract: On-demand controlled drug delivery is essential for the treatment of a wide range of chronic diseases. As the drug is released at the time when required, its efficacy is boosted and the side effects are minimized. However, so far, drug delivery devices often rely on the passive diffusion process for a sustained release, which is slow and uncontrollable. Here, we present a miniaturized microfluidic device for wirelessly controlled ultrafast active drug delivery, driven by an oscillating solid-liquid interface. The oscillation generates acoustic streaming in the drug reservoir, which opens an elastic valve to deliver the drug. High-speed microscopy reveals the fast response of the valve on the order of 1 ms, which is more than three orders of magnitude faster than the start-of-the-art. The amount of the released drug exhibits a linear relationship with the working time and the electric power applied to the ultrasonic resonator. The trigger of the release is wirelessly controlled via a magnetic field, and the system shows stable output in a continuous experiment for two weeks. The integrated system shows great promise as a long-term controlled drug delivery implant for chronic diseases.


title: Single-Channel Robot Ego-Speech Filtering during Human-Robot Interaction

abstract: In this paper, we study how well human speech can automatically be filtered when this overlaps with the voice and fan noise of a social robot, Pepper. We ultimately aim for an HRI scenario where the microphone can remain open when the robot is speaking, enabling a more natural turn-taking scheme where the human can interrupt the robot. To respond appropriately, the robot would need to understand what the interlocutor said in the overlapping part of the speech, which can be accomplished by target speech extraction (TSE). To investigate how well TSE can be accomplished in the context of the popular social robot Pepper, we set out to manufacture a datase composed of a mixture of recorded speech of Pepper itself, its fan noise (which is close to the microphones), and human speech as recorded by the Pepper microphone, in a room with low reverberation and high reverberation. Comparing a signal processing approach, with and without post-filtering, and a convolutional recurrent neural network (CRNN) approach to a state-of-the-art speaker identification-based TSE model, we found that the signal processing approach without post-filtering yielded the best performance in terms of Word Error Rate on the overlapping speech signals with low reverberation, while the CRNN approach is more robust for reverberation. These results show that estimating the human voice in overlapping speech with a robot is possible in real-life application, provided that the room reverberation is low and the human speech has a high volume or high pitch.


title: Cross-Domain Image Conversion by CycleDM

abstract: The purpose of this paper is to enable the conversion between machine-printed character images (i.e., font images) and handwritten character images through machine learning. For this purpose, we propose a novel unpaired image-to-image domain conversion method, CycleDM, which incorporates the concept of CycleGAN into the diffusion model. Specifically, CycleDM has two internal conversion models that bridge the denoising processes of two image domains. These conversion models are efficiently trained without explicit correspondence between the domains. By applying machine-printed and handwritten character images to the two modalities, CycleDM realizes the conversion between them. Our experiments for evaluating the converted images quantitatively and qualitatively found that ours performs better than other comparable approaches.


title: TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax

abstract: The quadratic complexity of the attention mechanism represents one of the biggest hurdles for processing long sequences using Transformers. Current methods, relying on sparse representations or stateful recurrence, sacrifice token-to-token interactions, which ultimately leads to compromises in performance. This paper introduces TaylorShift, a novel reformulation of the Taylor softmax that enables computing full token-to-token interactions in linear time and space. We analytically determine the crossover points where employing TaylorShift becomes more efficient than traditional attention, aligning closely with empirical measurements. Specifically, our findings demonstrate that TaylorShift enhances memory efficiency for sequences as short as 800 tokens and accelerates inference for inputs of approximately 1700 tokens and beyond. For shorter sequences, TaylorShift scales comparably with the vanilla attention. Furthermore, a classification benchmark across five tasks involving long sequences reveals no degradation in accuracy when employing Transformers equipped with TaylorShift. For reproducibility, we provide access to our code under https://github.com/tobna/TaylorShift.


title: Quantum for Good and the Societal Impact of Quantum Computing

abstract: Quantum computing promises to help humanity solve problems that would otherwise be intractable on classical computers. Unlike today's machines, quantum computers use a novel computing process that leverages the foundational quantum mechanical laws of nature. This unlocks unparalleled compute power for certain applications and promises to help solve some of our generation's gravest challenges, including the climate crisis, food insecurity, and widespread disease. No one entity will be able to realize this end state alone. Developing a fault-tolerant quantum supercomputer and a vibrant ecosystem around it will require deep partnerships between industry, governments, and academia. It will also require collective action to enable and promote positive applications of quantum computing and ensure that the safe and responsible use of the technology is at the center of its development and deployment. Achieving these objectives will require focusing on three priorities: 1. Impact. Ensure quantum computing benefits all of humankind by developing quantum solutions to solve critical, global problems. 2. Use. Protect against malicious use by accelerating the deployment of quantum-safe cryptography and developing governance processes and controls for the responsible use of quantum machines. 3. Access. Democratize the potential for economic growth across all of society through skilling, workforce and ecosystem development, and digital infrastructure. This paper discusses each in turn.


title: From Spectra to Biophysical Insights: End-to-End Learning with a Biased Radiative Transfer Model

abstract: Advances in machine learning have boosted the use of Earth observation data for climate change research. Yet, the interpretability of machine-learned representations remains a challenge, particularly in understanding forests' biophysical reactions to climate change. Traditional methods in remote sensing that invert radiative transfer models (RTMs) to retrieve biophysical variables from spectral data often fail to account for biases inherent in the RTM, especially for complex forests. We propose to integrate RTMs into an auto-encoder architecture, creating an end-to-end learning approach. Our method not only corrects biases in RTMs but also outperforms traditional techniques for variable retrieval like neural network regression. Furthermore, our framework has potential generally for inverting biased physical models. The code is available on https://github.com/yihshe/ai-refined-rtm.git.


title: Galled Tree-Child Networks

abstract: We propose the class of galled tree-child networks which is obtained as intersection of the classes of galled networks and tree-child networks. For the latter two classes, (asymptotic) counting results and stochastic results have been proved with very different methods. We show that a counting result for the class of galled tree-child networks follows with similar tools as used for galled networks, however, the result has a similar pattern as the one for tree-child networks. In addition, we also consider the (suitably scaled) numbers of reticulation nodes of random galled tree-child networks and show that they are asymptotically normal distributed. This is in contrast to the limit laws of the corresponding quantities for galled networks and tree-child networks which have been both shown to be discrete.


title: On token signed graphs

abstract: We introduce the concept of a $k$-token signed graph and study some of its combinatorial and algebraic properties. We prove that two switching isomorphic signed graphs have switching isomorphic token graphs. Moreover, we show that the Laplacian spectrum of a balanced signed graph is contained in the Laplacian spectra of its $k$-token signed graph. Besides, we introduce and study the unbalance level of a signed graph, which is a new parameter that measures how far a signed graph is from being balanced. Moreover, we study the relation between the frustration index and the unbalance level of signed graphs and their token signed graphs.


title: Weighted floating functions and weighted functional affine surface areas

abstract: The purpose of this paper is to introduce the new concept of weighted floating functions associated with log concave or $s$-concave functions. This leads to new notions of weighted functional affine surface areas. Their relation to more traditional versions of functional affine surface areas as well as to the classical affine surface areas for convex bodies is discussed in detail.


title: Cascade enhancement of magnetic dipole emission and efficient collection of photons by the hybrid topological structure

abstract: High photon emission rate, high collection efficiency and stability are all important for single photon source applications. Here we demonstrate that both cascade enhancement of magnetic dipole emission and efficient collection of emitted photons can be realized simultaneously in a hybrid structure of a two-dimensional honeycomb topological photonic crystal containing dielectric nanodisk. The magnetic dipole resonance of nanodisk can effectively excite topological edgestate due to their near field overlapping. If a magnetic emitter is used to excite the nanodisk, then its magnetic dipole resonance can be viewed as a large equivalent dipole interacting with the edgestates, which achieves the cascade enhancement of the magnetic emitter. In addition, almost all the scattered photons around the nanodisk can be collected through topological edge state with the collection efficiency up to 95%. The proposed mechanism may provide the practical applications of on-chip robust single photon sources and nanolasers.


title: Risk-Constrained Community Battery Utilisation Optimisation for Electric Vehicle Charging with Photovoltaic Resources

abstract: High penetration of renewable generation in the electricity grid presents power system operators with challenges including voltage instability mainly due to fluctuating power generation. To cope with intermittent generation, community batteries introduce an elegant solution for storing excess generation of renewable resources and reverting to the grid in peak demand periods. The question of the right battery type and size coupled with the right investment is challenging. Furthermore, the growth in adapting EVs imposes additional demand challenges on the power system compared to traditional industrial and household demand. This paper introduces long-term planning for community batteries to capture the surplus generation of PV resources for a given area and redirect these resources to charge EVs, without direct injection to the grid. For long-term investment planning on batteries, we consider 15 years' worth of historical data associated with solar irradiance, temperature, EV demands, and household demands. A novel stochastic mathematical model is proposed for decision-making on battery specifications (the type and capacity per year) based on the four standard battery types provided by the CSIRO in Australia. Uncertainties related to the EVs and RESs are captured by a non-parametric robust technique, named information gap decision theory, from optimistic and pessimistic perspectives. The investment decision-making part is formulated as mixed-integer linear programming taking advantage of the powerful commercial solver -- GUROBI -- which leads to finding feasible global solutions with low computational burden. The outcomes of this investigation not only detect optimal battery installation strategies to improve the stability profile of the grid by capturing the excess generation of PV resources but also facilitate EV integration in the community toward reaching net-zero emissions targets.


title: User-Driven Adaptation: Tailoring Autonomous Driving Systems with Dynamic Preferences

abstract: In the realm of autonomous vehicles, dynamic user preferences are critical yet challenging to accommodate. Existing methods often misrepresent these preferences, either by overlooking their dynamism or overburdening users as humans often find it challenging to express their objectives mathematically. The previously introduced framework, which interprets dynamic preferences as inherent uncertainty and includes a ``human-on-the-loop'' mechanism enabling users to give feedback when dissatisfied with system behaviors, addresses this gap. In this study, we further enhance the approach with a user study of 20 participants, focusing on aligning system behavior with user expectations through feedback-driven adaptation. The findings affirm the approach's ability to effectively merge algorithm-driven adjustments with user complaints, leading to improved participants' subjective satisfaction in autonomous systems.


title: Loss Design for Single-carrier Joint Communication and Neural Network-based Sensing

abstract: We evaluate the influence of multi-snapshot sensing and varying signal-to-noise ratio (SNR) on the overall performance of neural network (NN)-based joint communication and sensing (JCAS) systems. To enhance the training behavior, we decouple the loss functions from the respective SNR values and the number of sensing snapshots, using bounds of the sensing performance. Pre-processing is done through conventional sensing signal processing steps on the inputs to the sensing NN. The proposed method outperforms classical algorithms, such as a Neyman-Pearson-based power detector for object detection and ESPRIT for angle of arrival (AoA) estimation for quadrature amplitude modulation (QAM) at low SNRs.


title: A Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Study

abstract: We present a detailed replication study of the BASS framework, an abstractive summarization system based on the notion of Unified Semantic Graphs. Our investigation includes challenges in replicating key components and an ablation study to systematically isolate error sources rooted in replicating novel components. Our findings reveal discrepancies in performance compared to the original work. We highlight the significance of paying careful attention even to reasonably omitted details for replicating advanced frameworks like BASS, and emphasize key practices for writing replicable papers.


title: Improving the quality of individual-level online information tracking: challenges of existing approaches and introduction of a new content- and long-tail sensitive academic solution

abstract: This article evaluates the quality of data collection in individual-level desktop information tracking used in the social sciences and shows that the existing approaches face sampling issues, validity issues due to the lack of content-level data and their disregard of the variety of devices and long-tail consumption patterns as well as transparency and privacy issues. To overcome some of these problems, the article introduces a new academic tracking solution, WebTrack, an open source tracking tool maintained by a major European research institution. The design logic, the interfaces and the backend requirements for WebTrack, followed by a detailed examination of strengths and weaknesses of the tool, are discussed. Finally, using data from 1185 participants, the article empirically illustrates how an improvement in the data collection through WebTrack leads to new innovative shifts in the processing of tracking data. As WebTrack allows collecting the content people are exposed to on more than classical news platforms, we can strongly improve the detection of politics-related information consumption in tracking data with the application of automated content analysis compared to traditional approaches that rely on the list-based identification of news.


title: RulePrompt: Weakly Supervised Text Classification with Prompting PLMs and Self-Iterative Logical Rules

abstract: Weakly supervised text classification (WSTC), also called zero-shot or dataless text classification, has attracted increasing attention due to its applicability in classifying a mass of texts within the dynamic and open Web environment, since it requires only a limited set of seed words (label names) for each category instead of labeled data. With the help of recently popular prompting Pre-trained Language Models (PLMs), many studies leveraged manually crafted and/or automatically identified verbalizers to estimate the likelihood of categories, but they failed to differentiate the effects of these category-indicative words, let alone capture their correlations and realize adaptive adjustments according to the unlabeled corpus. In this paper, in order to let the PLM effectively understand each category, we at first propose a novel form of rule-based knowledge using logical expressions to characterize the meanings of categories. Then, we develop a prompting PLM-based approach named RulePrompt for the WSTC task, consisting of a rule mining module and a rule-enhanced pseudo label generation module, plus a self-supervised fine-tuning module to make the PLM align with this task. Within this framework, the inaccurate pseudo labels assigned to texts and the imprecise logical rules associated with categories mutually enhance each other in an alternative manner. That establishes a self-iterative closed loop of knowledge (rule) acquisition and utilization, with seed words serving as the starting point. Extensive experiments validate the effectiveness and robustness of our approach, which markedly outperforms state-of-the-art weakly supervised methods. What is more, our approach yields interpretable category rules, proving its advantage in disambiguating easily-confused categories.


title: Fuzzy Datalog$^\exists$ over Arbitrary t-Norms

abstract: One of the main challenges in the area of Neuro-Symbolic AI is to perform logical reasoning in the presence of both neural and symbolic data. This requires combining heterogeneous data sources such as knowledge graphs, neural model predictions, structured databases, crowd-sourced data, and many more. To allow for such reasoning, we generalise the standard rule-based language Datalog with existential rules (commonly referred to as tuple-generating dependencies) to the fuzzy setting, by allowing for arbitrary t-norms in the place of classical conjunctions in rule bodies. The resulting formalism allows us to perform reasoning about data associated with degrees of uncertainty while preserving computational complexity results and the applicability of reasoning techniques established for the standard Datalog setting. In particular, we provide fuzzy extensions of Datalog chases which produce fuzzy universal models and we exploit them to show that in important fragments of the language, reasoning has the same complexity as in the classical setting.


title: iSummary: Workload-based, Personalized Summaries for Knowledge Graphs

abstract: The explosion in the size and the complexity of the available Knowledge Graphs on the web has led to the need for efficient and effective methods for their understanding and exploration. Semantic summaries have recently emerged as methods to quickly explore and understand the contents of various sources. However in most cases they are static not incorporating user needs and preferences and cannot scale. In this paper we present iSummary a novel scalable approach for constructing personalized summaries. As the size and the complexity of the Knowledge Graphs for constructing personalized summaries prohibit efficient summary construction, in our approach we exploit query logs. The main idea behind our approach is to exploit knowledge captured in existing user queries for identifying the most interesting resources and linking them constructing as such highquality personalized summaries. We present an algorithm with theoretical guarantees on the summarys quality linear in the number of queries available in the query log. We evaluate our approach using three realworld datasets and several baselines showing that our approach dominates other methods in terms of both quality and efficiency.


title: Self-interacting quantum particles

abstract: The real Hilbert space formalism developed within the quaternionic quantum mechanics ($\mathbb H$QM) is fully applied to the simple model of the autonomous particle. This framework permits novel insights within the usual description of the complex autonomous particle, particulaly concening the energy of a non-stationary motion. Through the appraisal of the physical role played by a fully quaternionic scalar potential, a original self-interaction within the quaternionic autonomous particle has been determined as well. Scattering processes are considered to illustrate these novel features.


title: AdAM: Adaptive Fault-Tolerant Approximate Multiplier for Edge DNN Accelerators

abstract: In this paper, we propose an architecture of a novel adaptive fault-tolerant approximate multiplier tailored for ASIC-based DNN accelerators.


title: Quantum Algorithms in a Superposition of Spacetimes

abstract: Quantum computers are expected to revolutionize our ability to process information. The advancement from classical to quantum computing is a product of our advancement from classical to quantum physics -- the more our understanding of the universe grows, so does our ability to use it for computation. A natural question that arises is, what will physics allow in the future? Can more advanced theories of physics increase our computational power, beyond quantum computing? An active field of research in physics studies theoretical phenomena outside the scope of explainable quantum mechanics, that form when attempting to combine Quantum Mechanics (QM) with General Relativity (GR) into a unified theory of Quantum Gravity (QG). QG is known to present the possibility of a quantum superposition of causal structure and event orderings. In the literature of quantum information theory, this translates to a superposition of unitary evolution orders. In this work we show a first example of a natural computational model based on QG, that provides an exponential speedup over standard quantum computation (under standard hardness assumptions). We define a model and complexity measure for a quantum computer that has the ability to generate a superposition of unitary evolution orders, and show that such computer is able to solve in polynomial time two of the fundamental problems in computer science: The Graph Isomorphism Problem ($\mathsf{GI}$) and the Gap Closest Vector Problem ($\mathsf{GapCVP}$), with gap $O\left( n \sqrt{n} \right)$. These problems are believed by experts to be hard to solve for a regular quantum computer. Interestingly, our model does not seem overpowered, and we found no obvious way to solve entire complexity classes that are considered hard in computer science, like the classes $\mathbf{NP}$ and $\mathbf{SZK}$.


title: AIx Speed: Playback Speed Optimization Using Listening Comprehension of Speech Recognition Models

abstract: Since humans can listen to audio and watch videos at faster speeds than actually observed, we often listen to or watch these pieces of content at higher playback speeds to increase the time efficiency of content comprehension. To further utilize this capability, systems that automatically adjust the playback speed according to the user's condition and the type of content to assist in more efficient comprehension of time-series content have been developed. However, there is still room for these systems to further extend human speed-listening ability by generating speech with playback speed optimized for even finer time units and providing it to humans. In this study, we determine whether humans can hear the optimized speech and propose a system that automatically adjusts playback speed at units as small as phonemes while ensuring speech intelligibility. The system uses the speech recognizer score as a proxy for how well a human can hear a certain unit of speech and maximizes the speech playback speed to the extent that a human can hear. This method can be used to produce fast but intelligible speech. In the evaluation experiment, we compared the speech played back at a constant fast speed and the flexibly speed-up speech generated by the proposed method in a blind test and confirmed that the proposed method produced speech that was easier to listen to.


title: PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Papers

abstract: With the rapid growth of scholarly archives, researchers subscribe to "paper alert" systems that periodically provide them with recommendations of recently published papers that are similar to previously collected papers. However, researchers sometimes struggle to make sense of nuanced connections between recommended papers and their own research context, as existing systems only present paper titles and abstracts. To help researchers spot these connections, we present PaperWeaver, an enriched paper alerts system that provides contextualized text descriptions of recommended papers based on user-collected papers. PaperWeaver employs a computational method based on Large Language Models (LLMs) to infer users' research interests from their collected papers, extract context-specific aspects of papers, and compare recommended and collected papers on these aspects. Our user study (N=15) showed that participants using PaperWeaver were able to better understand the relevance of recommended papers and triage them more confidently when compared to a baseline that presented the related work sections from recommended papers.


title: ISC: an RADI-type method for stochastic continuous-time algebraic Riccati equations

abstract: In this paper, we propose an RADI-type method for large-scale stochastic continuous-time algebraic Riccati equations with sparse and low-rank structures. The so-called ISC method is developed by using the Incorporation idea together with different Shifts to accelerate the convergence and Compressions to reduce the storage and complexity. Numerical experiments are given to show its efficiency.


title: Ruin Probability Approximation for Bidimensional Brownian Risk Model with Tax

abstract: Let $\mathbf{B}(t)=(B_1(t), B_2(t))$, $t\geq 0$ be a two-dimensional Brownian motion with independent components and define the $\mathbf{\gamma}$-reflected process $$\mathbf{X}(t)=(X_1(t),X_2(t))=\left(B_1(t)-c_1t-\gamma_1\inf_{s_1\in[0,t]}(B_1(s_1)-c_1s_1),B_2(t)-c_2t-\gamma_2\inf_{s_2\in[0,t]}(B_2(s_2)-c_2s_2)\right),$$ with given finite constants $c_1,c_2,\gamma_1,\gamma_2$ and $\gamma_1,\gamma_2\in[0,1]$. The goal of this paper is to derive the asymptotics of ruin probability $$\mathbb{P}\{\exists_{t\in[0,T]}: X_1(t)>u,X_2(t)>au\}$$ as $u\to\infty$ taking $a\leq 1$ and $T>0$.


title: Tensor Decomposition-based Time Varying Channel Estimation for mmWave MIMO-OFDM Systems

abstract: In this paper, we consider the time-varying channel estimation in millimeter wave (mmWave) multiple-input multiple-output MIMO systems with hybrid beamforming architectures. Different from the existing contributions that considered single-carrier mmWave systems with high mobility, the wideband orthogonal frequency division multiplexing (OFDM) system is considered in this work. To solve the channel estimation problem under channel double selectivity, we propose a pilot transmission scheme based on 5G OFDM, and the received signals are formed as a fourth-order tensor, which fits the low-rank CANDECOMP/PARAFAC (CP) model. By further exploring the Vandermonde structure of factor matrix, a tensor-subspace decomposition based channel estimation method is proposed to solve the CP decomposition, where the uniqueness condition is analyzed. Based on the decomposed factor matrices, the channel parameters, including angles of arrival/departure, delays, channel gains and Doppler shifts are estimated, and the Cram\'{e}r-Rao bound (CRB) results are derived as performance metrics. Simulation results demonstrate the superior performance of the proposed method over other benchmarks. Furthermore, the channel estimation methods are tested based on the channel parameters generated by Wireless InSites, and simulation results show the effectiveness of the proposed method in practical scenarios.


title: Transcription factor clusters as information transfer agents

abstract: Deciphering how genes interpret information from the concentration of transcription factors (TFs) within the cell nucleus remains a fundamental question in gene regulation. Recent advancements have unveiled the heterogeneous distribution of TF molecules in the nucleus, posing challenges to the precise decoding of concentration signals. To explore this phenomenon, we employ high-resolution single-cell imaging of a fluorescently tagged TF protein, Bicoid, in living fly embryos. We show that accumulation of Bicoid in submicron clusters preserves the spatial information of the maternal Bicoid gradient, and that cluster intensity, size, and frequency offer remarkably precise spatial cues. We further discover that various known gene targets of Bicoid activation colocalize with clusters and that for the target gene Hunchback, this colocalization is dependent on its enhancer binding affinity. Modeling information transfer through these clusters suggests that clustering offers a more rapid sensing mechanism for global nuclear concentrations than freely diffusing TF molecules detected by simple enhancers.


title: Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelity

abstract: Recent advances in text-guided image compression have shown great potential to enhance the perceptual quality of reconstructed images. These methods, however, tend to have significantly degraded pixel-wise fidelity, limiting their practicality. To fill this gap, we develop a new text-guided image compression algorithm that achieves both high perceptual and pixel-wise fidelity. In particular, we propose a compression framework that leverages text information mainly by text-adaptive encoding and training with joint image-text loss. By doing so, we avoid decoding based on text-guided generative models -- known for high generative diversity -- and effectively utilize the semantic information of text at a global level. Experimental results on various datasets show that our method can achieve high pixel-level and perceptual quality, with either human- or machine-generated captions. In particular, our method outperforms all baselines in terms of LPIPS, with some room for even more improvements when we use more carefully generated captions.


title: Unsupervised Learning Approaches for Identifying ICU Patient Subgroups: Do Results Generalise?

abstract: The use of unsupervised learning to identify patient subgroups has emerged as a potentially promising direction to improve the efficiency of Intensive Care Units (ICUs). By identifying subgroups of patients with similar levels of medical resource need, ICUs could be restructured into a collection of smaller subunits, each catering to a specific group. However, it is unclear whether common patient subgroups exist across different ICUs, which would determine whether ICU restructuring could be operationalised in a standardised manner. In this paper, we tested the hypothesis that common ICU patient subgroups exist by examining whether the results from one existing study generalise to a different dataset. We extracted 16 features representing medical resource need and used consensus clustering to derive patient subgroups, replicating the previous study. We found limited similarities between our results and those of the previous study, providing evidence against the hypothesis. Our findings imply that there is significant variation between ICUs; thus, a standardised restructuring approach is unlikely to be appropriate. Instead, potential efficiency gains might be greater when the number and nature of the subunits are tailored to each ICU individually.


title: SAFFIRA: a Framework for Assessing the Reliability of Systolic-Array-Based DNN Accelerators

abstract: Systolic array has emerged as a prominent architecture for Deep Neural Network (DNN) hardware accelerators, providing high-throughput and low-latency performance essential for deploying DNNs across diverse applications. However, when used in safety-critical applications, reliability assessment is mandatory to guarantee the correct behavior of DNN accelerators. While fault injection stands out as a well-established practical and robust method for reliability assessment, it is still a very time-consuming process. This paper addresses the time efficiency issue by introducing a novel hierarchical software-based hardware-aware fault injection strategy tailored for systolic array-based DNN accelerators.


title: Phase Behavior and Dynamics of Active Brownian Particles in an Alignment Field

abstract: Self-propelled particles that are subject to noise are a well-established generic model system for active matter. A homogeneous alignment field can be used to orient the direction of the self-propulsion velocity and to model systems like phoretic Janus particles with a magnetic dipole moment or magnetotactic bacteria in an external magnetic field. Computer simulations are used to predict the phase behavior and dynamics of self-propelled Brownian particles in a homogeneous alignment field in two dimensions. Phase boundaries of the gas-liquid coexistence region are calculated for various P\'eclet numbers, particle densities, and alignment field strengths. Critical points and exponents are calculated and, in agreement with previous simulations, do not seem to belong to the universality class of the 2D Ising model. Finally, the dynamics of spinodal decomposition for quenching the system from the one-phase to the two-phase coexistence region by increasing P\'eclet number is characterized. Our results may help to identify parameters for optimal transport of active matter in complex environments.


title: Front-end electronics development of large-area SiPM arrays for high-precision single-photon time measurement

abstract: TRopIcal DEep-sea Neutrino Telescope (TRIDENT) plans to incorporate silicon photomultipliers (SiPMs) with superior time resolution in addition to photomultiplier tubes (PMTs) into its detection units, namely hybrid Digital Optical Modules (hDOMs), to improve its angular resolution. However, the time resolution significantly degrades for large-area SiPMs due to the large detector capacitance, posing significant challenges for the readout electronics of SiPMs in hDOM. We analyzed the influences of series and parallel connections when constructing a large-area SiPM array and designed a series-parallel connection SiPM array with differential output. We also designed a high-speed pre-amplifier based on transformers (MABA-007159) and radio frequency amplifiers (BGA2803), and an analog multi-channel summing circuit based on operational amplifiers (LMH6629). We measured the single photon time resolution (SPTR) of a $4\times4$ SiPM (Hamamatsu S13360-3050PE) array ($12\times12~\mathrm{mm}^2$) of approximately 300 ps FWHM. This front-end readout design enables the large-area SiPM array to achieve high-precision single photon time measurement in one readout channel.


title: Radial amplitude equations for fully localised planar patterns

abstract: Isolated patches of spatially oscillating pattern have been found to emerge near a pattern-forming instability in a wide variety of experiments and mathematical models. However, there is currently no mathematical theory to explain this emergence or characterise the structure of these patches. We provide a method for formally deriving radial amplitude equations to planar patterns via non-autonomous multiple-scale analysis and convolutional sums of products of Bessel functions. Our novel approach introduces nonautonomous differential operators, which allow for the systematic manipulation of Bessel functions, as well as previously unseen identities involving infinite sums of Bessel functions. Solutions of the amplitude equations describe fully localised patterns with non-trivial angular dependence, where localisation occurs in a purely radial direction. Amplitude equations are derived for multiple examples of patterns with dihedral symmetry, including fully localised hexagons and quasipatterns with twelve-fold rotational symmetry. In particular, we show how to apply the asymptotic method to the Swift--Hohenberg equation and general reaction-diffusion systems.


title: A general approach to enhance the survivability of backdoor attacks by decision path coupling

abstract: Backdoor attacks have been one of the emerging security threats to deep neural networks (DNNs), leading to serious consequences. One of the mainstream backdoor defenses is model reconstruction-based. Such defenses adopt model unlearning or pruning to eliminate backdoors. However, little attention has been paid to survive from such defenses. To bridge the gap, we propose Venom, the first generic backdoor attack enhancer to improve the survivability of existing backdoor attacks against model reconstruction-based defenses. We formalize Venom as a binary-task optimization problem. The first is the original backdoor attack task to preserve the original attack capability, while the second is the attack enhancement task to improve the attack survivability. To realize the second task, we propose attention imitation loss to force the decision path of poisoned samples in backdoored models to couple with the crucial decision path of benign samples, which makes backdoors difficult to eliminate. Our extensive evaluation on two DNNs and three datasets has demonstrated that Venom significantly improves the survivability of eight state-of-the-art attacks against eight state-of-the-art defenses without impacting the capability of the original attacks.


title: Benchmarking the Text-to-SQL Capability of Large Language Models: A Comprehensive Evaluation

abstract: Large Language Models (LLMs) have emerged as a powerful tool in advancing the Text-to-SQL task, significantly outperforming traditional methods. Nevertheless, as a nascent research field, there is still no consensus on the optimal prompt templates and design frameworks. Additionally, existing benchmarks inadequately explore the performance of LLMs across the various sub-tasks of the Text-to-SQL process, which hinders the assessment of LLMs' cognitive capabilities and the optimization of LLM-based solutions. To address the aforementioned issues, we firstly construct a new dataset designed to mitigate the risk of overfitting in LLMs. Then we formulate five evaluation tasks to comprehensively assess the performance of diverse methods across various LLMs throughout the Text-to-SQL process.Our study highlights the performance disparities among LLMs and proposes optimal in-context learning solutions tailored to each task. These findings offer valuable insights for enhancing the development of LLM-based Text-to-SQL systems.


title: Role of long jumps in L\'evy noise induced multimodality

abstract: L\'evy noise is a paradigmatic noise used to describe out-of-equilibrium systems. Typically, properties of L\'evy noise driven systems are very different from their Gaussian white noise driven counterparts. In particular, under action of L\'evy noise, stationary states in single-well, super-harmonic, potentials are no longer unimodal. Typically, they are bimodal however for fine-tuned potentials the number of modes can be further increased. The multimodality arises as a consequence of the competition between long displacements induced by the non-equilibrium stochastic driving and action of the deterministic force. Here, we explore robustness of bimodality in the quartic potential under action of the L\'evy noise. We explore various scenarios of bounding long jumps and assess their ability to weaken and destroy multimodality. In general, we demonstrate that despite its robustness it is possible to destroy the bimodality, however it requires drastic reduction in the length of noise-induced jumps.


title: Single-level Robust Bidding of Renewable-only Virtual Power Plant in Energy and Ancillary Service Markets for Worst-case Profit

abstract: This paper proposes a novel single-level robust mathematical approach to model the RES-only Virtual Power Plant (RVPP) bidding problem in the simultaneous Day Ahead Market (DAM) and Secondary Reserve Market (SRM). The worst-case profit of RVPP due to uncertainties related to electricity prices, Non-dispatchable Renewable Energy Sources (ND-RES) production, and flexible demand is captured. In order to find the worst-case profit in a single-level model, the relationship between price and energy uncertainties leads to some non-linear constraints, which are appropriately linearized. The simulation results show the superiority of the proposed robust model compared to those in the literature, as well as its computational efficiency.


title: Exploring language endangerment: historical, geographical, and economic insights from multilayer language-country bipartite network analysis

abstract: Language endangerment is a phenomenon in which approximately 40% of languages spoken worldwide are predicted to disappear within the next few decades, resulting in the loss of cultures associated with these languages. To take effective measures against language endangerment, it is essential to quantitatively understand its characteristics because it is a phenomenon in which historical, geographical, and economic factors are intricately intertwined. In this study, multilayer language-country bipartite networks are constructed using information about which countries each language is spoken in and two types of linguistic features, namely the existence of a writing system and the function within a country. In addition, percolation simulations are conducted to measure how language and country networks break down according to the extinction of languages and to identify vulnerable connections in them. In the language network of officially used languages with their writing system, the community analysis indicated that there were communities composed of languages spoken over geographically separated distances. The strength of languages revealed that the official languages in the former colonial nations, namely English, French, Spanish, Dutch, Portuguese, and Russian, still played significant roles in the formation of these communities. In the language and country networks of unofficially used languages without their writing system, the percolation simulation revealed that languages were likely to severely disappear in the Americas, and that linguistic diversity was vulnerable in affluent countries. The findings show that the analysis of multilayer language-country bipartite networks has enabled a quantitative understanding of the language endangerment occurring worldwide from historical, geographical, and economic perspectives.


title: XAI-Based Detection of Adversarial Attacks on Deepfake Detectors

abstract: We introduce a novel methodology for identifying adversarial attacks on deepfake detectors using eXplainable Artificial Intelligence (XAI). In an era characterized by digital advancement, deepfakes have emerged as a potent tool, creating a demand for efficient detection systems. However, these systems are frequently targeted by adversarial attacks that inhibit their performance. We address this gap, developing a defensible deepfake detector by leveraging the power of XAI. The proposed methodology uses XAI to generate interpretability maps for a given method, providing explicit visualizations of decision-making factors within the AI models. We subsequently employ a pretrained feature extractor that processes both the input image and its corresponding XAI image. The feature embeddings extracted from this process are then used for training a simple yet effective classifier. Our approach contributes not only to the detection of deepfakes but also enhances the understanding of possible adversarial attacks, pinpointing potential vulnerabilities. Furthermore, this approach does not change the performance of the deepfake detector. The paper demonstrates promising results suggesting a potential pathway for future deepfake detection mechanisms. We believe this study will serve as a valuable contribution to the community, sparking much-needed discourse on safeguarding deepfake detectors.


title: Review of Nanolayered Post-transition Metal Monochalcogenides: Synthesis, Properties, and Applications

abstract: Nanolayered post-transition metal monochalcogenides (PTMMCs) stand out as promising advanced two-dimensional (2D) materials. Beyond inheriting the general advantages associated with traditional 2D materials, they exhibit unique properties, including a wide bandgap range covering the ultraviolet to the mid-infrared spectral ranges, thickness-dependent bandgap behaviors, good nonlinear optical performance, high thermoelectric coefficients, and ferroelectricity. Consequently, these materials hold significant potential in diverse applications such as photodetectors, field effect transistors, thermoelectrics, ferroelectrics, photovoltaics, and electrochemical devices, especially in the manufacturing of nanoscale devices. However, there is still a lack of systematic understanding of the PTMMC family. This study provides a broad overview of the crystal structures, bandgap structures, synthesis methods, physical properties, and state-of-the-art applications of PTMMC materials with a motif of X-M-M-X (M=Ga, In, Ge, Sn; X=S, Se, Te). An outlook for the development trends is emphasized at the end, underscoring the critical importance of this work to the future exploration of nanolayered PTMMCs.


title: On the Asymptotic Mean Square Error Optimality of Diffusion Models

abstract: Diffusion models (DMs) as generative priors have recently shown great potential for denoising tasks but lack theoretical understanding with respect to their mean square error (MSE) optimality. This paper proposes a novel denoising strategy inspired by the structure of the MSE-optimal conditional mean estimator (CME). The resulting DM-based denoiser can be conveniently employed using a pre-trained DM, being particularly fast by truncating reverse diffusion steps and not requiring stochastic re-sampling. We present a comprehensive (non-)asymptotic optimality analysis of the proposed diffusion-based denoiser, demonstrating polynomial-time convergence to the CME under mild conditions. Our analysis also derives a novel Lipschitz constant that depends solely on the DM's hyperparameters. Further, we offer a new perspective on DMs, showing that they inherently combine an asymptotically optimal denoiser with a powerful generator, modifiable by switching re-sampling in the reverse process on or off. The theoretical findings are thoroughly validated with experiments based on various benchmark datasets.


title: Location of the zeros of quaternionic polynomials using matrix tools

abstract: Using a variety of matrix techniques, the problem of locating the left eigenvalues of the quaternion companion matrices are investigated in this paper. In a recent paper, Dar et al. [6], proved that the zeros of a quaternionic polynomial and the left eigenvalues of corresponding companion matrix are same. In view of this, we use various newly developed matrix techniques to prove various results concerning the location of the zeros of regular polynomials of a quaternionic variable with quaternionic coefficients, which include an extension of the result of A. L. Cauchy as well.


title: SimuCourt: Building Judicial Decision-Making Agents with Real-world Judgement Documents

abstract: With the development of deep learning, natural language processing technology has effectively improved the efficiency of various aspects of the traditional judicial industry. However, most current efforts focus solely on individual judicial stage, overlooking cross-stage collaboration. As the autonomous agents powered by large language models are becoming increasingly smart and able to make complex decisions in real-world settings, offering new insights for judicial intelligence. In this paper, (1) we introduce SimuCourt, a judicial benchmark that encompasses 420 judgment documents from real-world, spanning the three most common types of judicial cases, and a novel task Judicial Decision-Making to evaluate the judicial analysis and decision-making power of agents. To support this task, we construct a large-scale judicial knowledge base, JudicialKB, with multiple legal knowledge. (2) we propose a novel multi-agent framework, AgentsCourt. Our framework follows the real-world classic court trial process, consisting of court debate simulation, legal information retrieval and judgement refinement to simulate the decision-making of judge. (3) we perform extensive experiments, the results demonstrate that, our framework outperforms the existing advanced methods in various aspects, especially in generating legal grounds, where our model achieves significant improvements of 8.6% and 9.1% F1 score in the first and second instance settings, respectively.


title: Regret-based budgeted decision rules under severe uncertainty

abstract: One way to make decisions under uncertainty is to select an optimal option from a possible range of options, by maximizing the expected utilities derived from a probability model. However, under severe uncertainty, identifying precise probabilities is hard. For this reason, imprecise probability models uncertainty through convex sets of probabilities, and considers decision rules that can return multiple options to reflect insufficient information. Many well-founded decision rules have been studied in the past, but none of those standard rules are able to control the number of returned alternatives. This can be a problem for large decision problems, due to the cognitive burden decision makers have to face when presented with a large number of alternatives. Our contribution proposes regret-based ideas to construct new decision rules which return a bounded number of options, where the limit on the number of options is set in advance by the decision maker as an expression of their cognitive limitation. We also study their consistency and numerical behaviour.


title: Ab initio simulation of the universal properties of unitary Fermi gas in a harmonic trap

abstract: Chang and Bertsch [Phys. Rev. A 76, 021603(R) (2007)] proposed a simple formula for the ground state energy of a unitary Fermi gas in a harmonic trap, based on their Green's function Monte Carlo simulations of up to 22 fermions, combined with general assumptions about the universal thermodynamic behavior of the unitary Fermi gas. In this work, we perform the ab initio simulations of the ground state energy of up to one hundred fermions using the fictitious identical particle method to overcome the Fermion sign problem, and we find that the formula proposed by Chang and Bertsch remains highly accurate. Since the number of fermions we simulate is much larger than that simulated by Chang and Bertsch when they proposed the formula, our work provides strong evidence for the universal validity of the formula. Our work demonstrates that fictitious identical particles provide a valuable tool for the ab initio simulations of ultracold Fermi gases.


title: WikiTableEdit: A Benchmark for Table Editing by Natural Language Instruction

abstract: Tabular data, as a crucial form of data representation, exists in diverse formats on the Web. When confronted with complex and irregular tables, manual modification becomes a laborious task. This paper investigates the performance of Large Language Models (LLMs) in the context of table editing tasks. Existing research mainly focuses on regular-shaped tables, wherein instructions are used to generate code in SQL, Python, or Excel Office-script for manipulating the tables. Nevertheless, editing tables with irregular structures, particularly those containing merged cells spanning multiple rows, poses a challenge when using code. To address this, we introduce the WikiTableEdit dataset. Leveraging 26,531 tables from the WikiSQL dataset, we automatically generate natural language instructions for six distinct basic operations and the corresponding outcomes, resulting in over 200,000 instances. Subsequently, we evaluate several representative large language models on the WikiTableEdit dataset to demonstrate the challenge of this task. The dataset will be released to the community to promote related researches.


title: Opportunistic User Scheduling for Secure RIS-aided Wireless Communications

abstract: In this paper, we provide expressions for the secrecy outage probability (SOP) for suboptimal and optimal opportunistic scheduling schemes in a reconfigurable intelligent surface (RIS) aided system with multiple eavesdroppers in approximate closed form. A suboptimal scheduling (SS) scheme is analyzed, which is used when the channel state information (CSI) of the eavesdropping links is unavailable, and the optimal scheduling (OS) scheme is also analyzed, which is used when the global CSI is available. For each scheme, we provide a simplified expression for the SOP in the high signal-to-noise ratio (SNR) regime to demonstrate its behavior as a function of the key system parameters. At high SNR, the SOP saturates to a constant level which decreases exponentially with the number of RIS elements in the SS scheme and with the product of the number of RIS elements and the number of users in the OS scheme. We compare the performance of the opportunistic user scheduling schemes with that of a non-orthogonal multiple access (NOMA) based scheduling scheme which chooses a pair of users in each time slot for scheduling and we show that the opportunistic schemes outperform the NOMA-based scheme. We also derive a closed-form expression for the SOP of a decode-and-forward (DF) relay-aided scheduling scheme in order to compare it with that of the RIS-aided system. It is found that the RIS-aided system outperforms the relay-aided systems when the number of RIS elements is sufficiently large. An increased number of RIS elements is required to outperform the relay-aided system at higher operating frequencies.


title: Balayage of measures: behavior near a corner

abstract: Consider the balayage measure $\nu = \mathrm{Bal}(\mu,\partial \Omega)$, where $\Omega$ is a finitely connected Jordan domain and $\mu$ is a probability measure on $\Omega$. Suppose $\partial \Omega$ has a H\"older-$C^1$ corner of opening $\pi \alpha$ at a point $z_0 \in \partial \Omega$ for some $0 < \alpha \leq 2$ and that $d\mu(z) \asymp |z-z_{0}|^{2b-2}d^{2}z$ as $z\to z_0$ for some $b > 0$. In this paper, we obtain the precise rate of vanishing of $\nu((\partial \Omega) \cap B_r(z_0))$ as $r\to 0$. This proves a recent conjecture made by one of the authors.


title: ChatGPT and biometrics: an assessment of face recognition, gender detection, and age estimation capabilities

abstract: This paper explores the application of large language models (LLMs), like ChatGPT, for biometric tasks. We specifically examine the capabilities of ChatGPT in performing biometric-related tasks, with an emphasis on face recognition, gender detection, and age estimation. Since biometrics are considered as sensitive information, ChatGPT avoids answering direct prompts, and thus we crafted a prompting strategy to bypass its safeguard and evaluate the capabilities for biometrics tasks. Our study reveals that ChatGPT recognizes facial identities and differentiates between two facial images with considerable accuracy. Additionally, experimental results demonstrate remarkable performance in gender detection and reasonable accuracy for the age estimation tasks. Our findings shed light on the promising potentials in the application of LLMs and foundation models for biometrics.


title: Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answering

abstract: Recent studies have investigated utilizing Knowledge Graphs (KGs) to enhance Quesetion Answering (QA) performance of Large Language Models (LLMs), yet structured KG verbalization remains challengin. Existing methods, such as triple-form or free-form textual conversion of triple-form facts, encounter several issues. These include reduced evidence density due to duplicated entities or relationships, and reduced evidence clarity due to an inability to emphasize crucial evidence. To address these issues, we propose EFSum, an Evidence-focused Fact Summarization framework for enhanced QA with knowledge-augmented LLMs. We optimize an open-source LLM as a fact summarizer through distillation and preference alignment. Our extensive experiments show that EFSum improves LLM's zero-shot QA performance, and it is possible to ensure both the helpfulness and faithfulness of the summary.


title: Non-Convex Stochastic Composite Optimization with Polyak Momentum

abstract: The stochastic proximal gradient method is a powerful generalization of the widely used stochastic gradient descent (SGD) method and has found numerous applications in Machine Learning. However, it is notoriously known that this method fails to converge in non-convex settings where the stochastic noise is significant (i.e. when only small or bounded batch sizes are used). In this paper, we focus on the stochastic proximal gradient method with Polyak momentum. We prove this method attains an optimal convergence rate for non-convex composite optimization problems, regardless of batch size. Additionally, we rigorously analyze the variance reduction effect of the Polyak momentum in the composite optimization setting and we show the method also converges when the proximal step can only be solved inexactly. Finally, we provide numerical experiments to validate our theoretical results.


title: Hamiltonian Property Testing

abstract: Locality is a fundamental feature of many physical time evolutions. Assumptions on locality and related structural properties also underlie recently proposed procedures for learning an unknown Hamiltonian from access to the induced time evolution. However, no protocols to rigorously test whether an unknown Hamiltonian is local were known. We investigate Hamiltonian locality testing as a property testing problem, where the task is to determine whether an unknown $n$-qubit Hamiltonian $H$ is $k$-local or $\varepsilon$-far from all $k$-local Hamiltonians, given access to the time evolution along $H$. First, we emphasize the importance of the chosen distance measure: With respect to the operator norm, a worst-case distance measure, incoherent quantum locality testers require $\tilde{\Omega}(2^n)$ many time evolution queries and an expected total evolution time of $\tilde{\Omega}(2^n / \varepsilon)$, and even coherent testers need $\Omega(2^{n/2})$ many queries and $\Omega(2^{n/2}/\varepsilon)$ total evolution time. In contrast, when distances are measured according to the normalized Frobenius norm, corresponding to an average-case distance, we give a sample-, time-, and computationally efficient incoherent Hamiltonian locality testing algorithm based on randomized measurements. In fact, our procedure can be used to simultaneously test a wide class of Hamiltonian properties beyond locality. Finally, we prove that learning a general Hamiltonian remains exponentially hard with this average-case distance, thereby establishing an exponential separation between Hamiltonian testing and learning. Our work initiates the study of property testing for quantum Hamiltonians, demonstrating that a broad class of Hamiltonian properties is efficiently testable even with limited quantum capabilities, and positioning Hamiltonian testing as an independent area of research alongside Hamiltonian learning.

categories: quant-ph cs.CC cs.DS cs.IT cs.LG math.IT


title: Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception

abstract: Multimodal Large Language Model (MLLMs) leverages Large Language Models as a cognitive framework for diverse visual-language tasks. Recent efforts have been made to equip MLLMs with visual perceiving and grounding capabilities. However, there still remains a gap in providing fine-grained pixel-level perceptions and extending interactions beyond text-specific inputs. In this work, we propose {\bf{AnyRef}}, a general MLLM model that can generate pixel-wise object perceptions and natural language descriptions from multi-modality references, such as texts, boxes, images, or audio. This innovation empowers users with greater flexibility to engage with the model beyond textual and regional prompts, without modality-specific designs. Through our proposed refocusing mechanism, the generated grounding output is guided to better focus on the referenced object, implicitly incorporating additional pixel-level supervision. This simple modification utilizes attention scores generated during the inference of LLM, eliminating the need for extra computations while exhibiting performance enhancements in both grounding masks and referring expressions. With only publicly available training data, our model achieves state-of-the-art results across multiple benchmarks, including diverse modality referring segmentation and region-level referring expression generation.


title: Periodically activated physics-informed neural networks for assimilation tasks for three-dimensional Rayleigh-Benard convection

abstract: We apply physics-informed neural networks to three-dimensional Rayleigh-Benard convection in a cubic cell with a Rayleigh number of Ra=10^6 and a Prandtl number of Pr=0.7 to assimilate the velocity vector field from given temperature fields and vice versa. With the respective ground truth data provided by a direct numerical simulation, we are able to evaluate the performance of the different activation functions applied (sine, hyperbolic tangent and exponential linear unit) and different numbers of neuron (32, 64, 128) for each of the five hidden layers of the multi-layer perceptron. The main result is that the use of a periodic activation function (sine) typically benefits the assimilation performance in terms of the analyzed metrics, correlation with the ground truth and mean average error. The higher quality of results from sine-activated physics-informed neural networks is also manifested in the probability density function and power spectra of the inferred velocity or temperature fields. Regarding the two assimilation directions, the assimilation of temperature fields based on velocities appeared to be more challenging in the sense that it exhibited a sharper limit on the number of neurons below which viable assimilation results could not be achieved.


title: Space Complexity of Euclidean Clustering

abstract: The $(k, z)$-Clustering problem in Euclidean space $\mathbb{R}^d$ has been extensively studied. Given the scale of data involved, compression methods for the Euclidean $(k, z)$-Clustering problem, such as data compression and dimension reduction, have received significant attention in the literature. However, the space complexity of the clustering problem, specifically, the number of bits required to compress the cost function within a multiplicative error $\varepsilon$, remains unclear in existing literature. This paper initiates the study of space complexity for Euclidean $(k, z)$-Clustering and offers both upper and lower bounds. Our space bounds are nearly tight when $k$ is constant, indicating that storing a coreset, a well-known data compression approach, serves as the optimal compression scheme. Furthermore, our lower bound result for $(k, z)$-Clustering establishes a tight space bound of $\Theta( n d )$ for terminal embedding, where $n$ represents the dataset size. Our technical approach leverages new geometric insights for principal angles and discrepancy methods, which may hold independent interest.


title: Bodioid: philosophical reflections on the hybrid of bodies and artefacts towards post-human

abstract: The advent of the post-human era has blurred the boundary between the body and artefacts. Further, external materials and information are more deeply integrated into the body, making emerging technology a key driving force for shaping post-human existence and promoting bodily evolution. Based on this, this study analyses the transformation process of three technological forms, namely tools, machines, and cyborgs, and reveals the construction of bodies and artefacts. From the phenomenological perspective, the essences of body and artefact existences are reflected upon, and the 'existence is construction' viewpoint is proposed. Furthermore, a technological design concept, 'bodioid', is proposed to meticulously depict the characteristics of integrating similarities and differences towards unity between the body and artefacts, based on the theoretical foundation of technology mediation and the materialization of morality. Finally, through analogizing the organizational form of language, the two key forms and specific mechanisms of bodioid construction, namely extension and mirroring, are indicated. With this in mind, the post-human existence landscape is discussed with the objective of providing theoretical insights into the study of the underlying philosophical principles of technological design.


title: Model Predictive Control for setpoint tracking

abstract: The main objective of tracking control is to steer the tracking error, that is the difference between the reference and the output, to zero while the plant's operation limits are satisfied. This requires that some assumptions on the evolution of the future values of the reference must be taken into account. Typically a simple evolution of the reference is considered, such as step, ramp, or parabolic reference signals. It is important to notice that the tracking problem considers possible variations in the reference to be tracked, such as steps or slope variations of the ramps. Then the tracking control problem is inherently uncertain, since the reference may differ from what is expected. If the value of the reference is changed, then there is no guarantee that the feasibility and stability properties of the resulting control law hold. This report presents the MPC for tracking (MPCT) approach, which ensures recursive feasibility and asymptotic stability of the setpoint when the value of the reference is changed.


title: Online Learning of Human Constraints from Feedback in Shared Autonomy

abstract: Real-time collaboration with humans poses challenges due to the different behavior patterns of humans resulting from diverse physical constraints. Existing works typically focus on learning safety constraints for collaboration, or how to divide and distribute the subtasks between the participating agents to carry out the main task. In contrast, we propose to learn a human constraints model that, in addition, considers the diverse behaviors of different human operators. We consider a type of collaboration in a shared-autonomy fashion, where both a human operator and an assistive robot act simultaneously in the same task space that affects each other's actions. The task of the assistive agent is to augment the skill of humans to perform a shared task by supporting humans as much as possible, both in terms of reducing the workload and minimizing the discomfort for the human operator. Therefore, we propose an augmentative assistant agent capable of learning and adapting to human physical constraints, aligning its actions with the ergonomic preferences and limitations of the human operator.


title: A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching

abstract: Sentence semantic matching is a research hotspot in natural language processing, which is considerably significant in various key scenarios, such as community question answering, searching, chatbot, and recommendation. Since most of the advanced models directly model the semantic relevance among words between two sentences while neglecting the \textit{keywords} and \textit{intents} concepts of them, DC-Match is proposed to disentangle keywords from intents and utilizes them to optimize the matching performance. Although DC-Match is a simple yet effective method for semantic matching, it highly depends on the external NER techniques to identify the keywords of sentences, which limits the performance of semantic matching for minor languages since satisfactory NER tools are usually hard to obtain. In this paper, we propose to generally and flexibly resolve the text into multi concepts for multilingual semantic matching to liberate the model from the reliance on NER models. To this end, we devise a \underline{M}ulti-\underline{C}oncept \underline{P}arsed \underline{S}emantic \underline{M}atching framework based on the pre-trained language models, abbreviated as \textbf{MCP-SM}, to extract various concepts and infuse them into the classification tokens. We conduct comprehensive experiments on English datasets QQP and MRPC, and Chinese dataset Medical-SM. Besides, we experiment on Arabic datasets MQ2Q and XNLI, the outstanding performance further prove MCP-SM's applicability in low-resource languages.


title: Ensemble Averages of $\mathbb{Z}_2$ Orbifold Classes of Narain CFTs

abstract: In this work we study families of $\mathbb{Z}_2$ orbifolds of toroidal conformal field theories based on both factorizable and non-factorizable target space tori. For these classes of theories, we analyze their moduli spaces, and compute their partition functions. Building on previous work, we express the calculated partition functions in terms of suitable Siegel-Narain theta functions that allow us to determine their ensemble averages. We express the derived averaged partition functions of the studied families of conformal field theories in a manifest modular invariant finite sum of products of real analytic Eisenstein series. We speculate on a tentative holographic three-dimensional dual bulk interpretations for the considered $\mathbb{Z}_2$ orbifold classes of ensembles of conformal field theories.


title: Fast Iterative Region Inflation for Computing Large 2-D/3-D Convex Regions of Obstacle-Free Space

abstract: Convex polytopes have compact representations and exhibit convexity, which makes them suitable for abstracting obstacle-free spaces from various environments. Existing methods for generating convex polytopes always struggle to strike a balance between two requirements, producing high-quality polytope and efficiency. Moreover, another crucial requirement for convex polytopes to accurately contain certain seed point sets, such as a robot or a front-end path, is proposed in various tasks, which we refer to as manageability. In this paper, we show that we can achieve generation of high-quality convex polytope while ensuring both efficiency and manageability simultaneously, by introducing Fast Iterative Regional Inflation (FIRI).FIRI consists of two iteratively executed submodules: Restrictive Inflation (RsI) and computation of the Maximum Volume Inscribed Ellipsoid (MVIE) of convex polytope. By explicitly incorporating constraints that include the seed point set, RsI guarantees manageability. Meanwhile, the iterative monotonic optimization of MVIE, which serves as a lower bound of the volume of convex polytope, ensures high-quality results of FIRI. In terms of efficiency, we design methods tailored to the low-dimensional and multi-constrained nature of both modules, resulting in orders of magnitude improvement compared to generic solvers. Notably, for 2-D MVIE, we present a novel analytical algorithm that achieves linear-time complexity for the first time, further enhancing the efficiency of FIRI in the 2-D scenario. Extensive benchmarks conducted against state-of-the-art methods validate the superior performance of FIRI in terms of quality, manageability, and efficiency. Furthermore, various real-world applications showcase the generality and practicality of FIRI. The high-performance code of FIRI will be open-sourced for the reference of the community.


title: System performance of a TDM test-bed with long flex harness towards the new X-IFU FPA-DM

abstract: SRON (Netherlands Institute for Space Research) is developing the Focal Plane Assembly (FPA) for Athena X-IFU, whose Demonstration Model (DM) will use for the first time a time domain multiplexing (TDM)-based readout system for the on-board transition-edge sensors (TES). We report on the characterization activities on a TDM setup provided by NASA Goddard Space Flight Center (GSFC) and National Institute for Standards and Technology (NIST) and tested in SRON cryogenic test facilities. The goal of these activities is to study the impact of the longer harness, closer to X-IFU specs, in a different EMI environment and switching from a single-ended to a differential readout scheme. In this contribution we describe the advancement in the debugging of the system in the SRON cryostat, which led to the demonstration of the nominal spectral performance of 2.8 eV at 5.9~keV with 16-row multiplexing, as well as an outlook for the future endeavours for the TDM readout integration on X-IFU's FPA-DM at SRON.


title: Regularised Canonical Correlation Analysis: graphical lasso, biplots and beyond

abstract: Recent developments in regularized Canonical Correlation Analysis (CCA) promise powerful methods for high-dimensional, multiview data analysis. However, justifying the structural assumptions behind many popular approaches remains a challenge, and features of realistic biological datasets pose practical difficulties that are seldom discussed. We propose a novel CCA estimator rooted in an assumption of conditional independencies and based on the Graphical Lasso. Our method has desirable theoretical guarantees and good empirical performance, demonstrated through extensive simulations and real-world biological datasets. Recognizing the difficulties of model selection in high dimensions and other practical challenges of applying CCA in real-world settings, we introduce a novel framework for evaluating and interpreting regularized CCA models in the context of Exploratory Data Analysis (EDA), which we hope will empower researchers and pave the way for wider adoption.


title: Fermionic Fixed-Point Structure of Asymptotically Safe QED with a Pauli Term

abstract: We test the physical viability of a recent proposal for an asymptotically safe modification of quantum electrodynamics (QED), whose ultraviolet physics is dominated by a non-perturbative Pauli spin-field coupling. We focus in particular on its compatibility with the absence of dynamical generation of fermion mass in QED. Studying the renormalization group flow of chiral four-fermion operators and their fixed points, we discover a distinct class of behavior compared to the standard picture of fixed-point annihilation at large gauge couplings and the ensuing formation of chiral condensates. Instead, transcritical bifurcations, where the fixed points merely exchange infrared stability, are observed. Provided that non-chiral operators remain irrelevant, our theory accommodates a universality class of light fermions for $N_{\text{f}} > 1$ irreducible Dirac flavors. On the contrary, in the special case of $N_{\text{f}} = 1$ flavor, this comes only at the expense of introducing one additional relevant parameter.


title: Doubly Abductive Counterfactual Inference for Text-based Image Editing

abstract: We study text-based image editing (TBIE) of a single image by counterfactual inference because it is an elegant formulation to precisely address the requirement: the edited image should retain the fidelity of the original one. Through the lens of the formulation, we find that the crux of TBIE is that existing techniques hardly achieve a good trade-off between editability and fidelity, mainly due to the overfitting of the single-image fine-tuning. To this end, we propose a Doubly Abductive Counterfactual inference framework (DAC). We first parameterize an exogenous variable as a UNet LoRA, whose abduction can encode all the image details. Second, we abduct another exogenous variable parameterized by a text encoder LoRA, which recovers the lost editability caused by the overfitted first abduction. Thanks to the second abduction, which exclusively encodes the visual transition from post-edit to pre-edit, its inversion -- subtracting the LoRA -- effectively reverts pre-edit back to post-edit, thereby accomplishing the edit. Through extensive experiments, our DAC achieves a good trade-off between editability and fidelity. Thus, we can support a wide spectrum of user editing intents, including addition, removal, manipulation, replacement, style transfer, and facial change, which are extensively validated in both qualitative and quantitative evaluations. Codes are in https://github.com/xuesong39/DAC.


title: Generalized Duffin-Kemmer-Petiau oscillator under Aharonov-Bohm flux in topological defects backgrounds

abstract: In this article, we study the generalized Duffin-Kemmer-Petiau (DKP) oscillator under the influence of quantum flux field in the topological defects produced by a cosmic string space-time and point-like global monopole. The generalized DKP oscillator will be investigated through a non-minimal substitution of the momentum operator $\vec{p} \to \left(\vec{p}+i\,M\,\omega\,\eta^0\,f(r)\,\hat{r}\right)$ in the relativistic DKP equation. We solve this generalized DKP oscillator in a cosmic string space-time background and obtain the energy levels and wave function of the oscillator field using the parametric Nikiforov-Uvarov method. Afterwards, we solve the generalized DKP-oscillator in a point-like global monopole space-time and obtain the energy levels and wave functions following the same method. In fact, it is shown there that the energy eigenvalues are influenced by the topological defect of cosmic string and point-like global monopole and gets modified compared to flat space results, and breaks the degeneracy of the energy levels. Furthermore, we observe that the eigenvalue solutions depends on the quantum flux field that shows the gravitational analogue of the Aharonov-Bohm effect and also gives us a persistent currents


title: Federated Learning Under Attack: Exposing Vulnerabilities through Data Poisoning Attacks in Computer Networks

abstract: Federated Learning (FL) is a machine learning (ML) approach that enables multiple decentralized devices or edge servers to collaboratively train a shared model without exchanging raw data. During the training and sharing of model updates between clients and servers, data and models are susceptible to different data-poisoning attacks. In this study, our motivation is to explore the severity of data poisoning attacks in the computer network domain because they are easy to implement but difficult to detect. We considered two types of data-poisoning attacks, label flipping (LF) and feature poisoning (FP), and applied them with a novel approach. In LF, we randomly flipped the labels of benign data and trained the model on the manipulated data. For FP, we randomly manipulated the highly contributing features determined using the Random Forest algorithm. The datasets used in this experiment were CIC and UNSW related to computer networks. We generated adversarial samples using the two attacks mentioned above, which were applied to a small percentage of datasets. Subsequently, we trained and tested the accuracy of the model on adversarial datasets. We recorded the results for both benign and manipulated datasets and observed significant differences between the accuracy of the models on different datasets. From the experimental results, it is evident that the LF attack failed, whereas the FP attack showed effective results, which proved its significance in fooling a server. With a 1% LF attack on the CIC, the accuracy was approximately 0.0428 and the ASR was 0.9564; hence, the attack is easily detectable, while with a 1% FP attack, the accuracy and ASR were both approximately 0.9600, hence, FP attacks are difficult to detect. We repeated the experiment with different poisoning percentages.


title: Assessing the distribution of cancer stem cells in tumorspheres

abstract: In previous theoretical research, we inferred that cancer stem cells (CSCs), the cells that presumably drive tumor growth and resistance to conventional cancer treatments, are not uniformly distributed in the bulk of a tumorsphere. To confirm this theoretical prediction, we cultivated tumorspheres enriched in CSCs, and performed immunofluorecent detection of the stemness marker SOX2 using a confocal microscope. In this article, we present a method developed to process the images that reconstruct the amount and location of the CSCs in the tumorspheres. Its advantage is the use of a statistical criterion to classify the cells in stem and differentiated instead of setting an arbitrary threshold. From the analysis of the results of the methods using graph theory and computational modeling, we concluded that the distribution of Cancer Stem Cells in an experimental tumorsphere is non-homogeneous. This method is independent of the tumorsphere assay being useful for analyzing images in which several different kinds of cells are stained with different markers.


title: Evolution Transformer: In-Context Evolutionary Optimization

abstract: Evolutionary optimization algorithms are often derived from loose biological analogies and struggle to leverage information obtained during the sequential course of optimization. An alternative promising approach is to leverage data and directly discover powerful optimization principles via meta-optimization. In this work, we follow such a paradigm and introduce Evolution Transformer, a causal Transformer architecture, which can flexibly characterize a family of Evolution Strategies. Given a trajectory of evaluations and search distribution statistics, Evolution Transformer outputs a performance-improving update to the search distribution. The architecture imposes a set of suitable inductive biases, i.e. the invariance of the distribution update to the order of population members within a generation and equivariance to the order of the search dimensions. We train the model weights using Evolutionary Algorithm Distillation, a technique for supervised optimization of sequence models using teacher algorithm trajectories. The resulting model exhibits strong in-context optimization performance and shows strong generalization capabilities to otherwise challenging neuroevolution tasks. We analyze the resulting properties of the Evolution Transformer and propose a technique to fully self-referentially train the Evolution Transformer, starting from a random initialization and bootstrapping its own learning progress. We provide an open source implementation under https://github.com/RobertTLange/evosax.


title: Quasi-diagrams and gentle algebras

abstract: Any gentle algebra $A$ with one maximal path corresponds to a unique quasi-diagram $\alpha$. We introduce the regularity for $\alpha$, and show that $A$ has finite global dimension if and only if $\alpha$ is regular. We characterize regular quasi-diagrams which remain regular under the dihedral group action. We prove that the set of maximal chord diagrams is the "biggest" one among the sets closed under taking Koszul dual and rotations.


title: Exciplex-driven blue OLEDs: unlocking multifunctionality applications

abstract: We present the development of multifunctional blue-emission organic light-emitting diodes (OLEDs) using TADF-exciplex materials. These OLEDs exhibit sensitivity to external stimuli and achieve a maximum external quantum efficiency (EQE) of 11.6 % through partly liquid processing. This technique allows for large-scale production on arbitrary geometries. The potential multifunctionality of the devices arises from their response to low external magnetic fields (up to 100 mT) with an efficiency up to 2.5 % for magnetoconductance, while maximum magneto-electroluminescence effects of 4.1 % were detected. We investigated novel aspects, including the utilization of two organic materials without further doping and the investigation of the impact of 2,2',2''-(1,3,5-Benzinetriyl)-tris(1phenyl-1-H-benzimidazole) (TPBi) processing in liquid and vapor form. The insights gained provide a fundamental understanding regarding the applicability of exciplex (EX) materials for fully solution-processed OLEDs through a deliberate omission of doping. Our work represents a significant advancement on the path towards multifunctional OLED technology, with potential applications in cost-efficient, scalable organic full-color displays and advanced sensing system


title: Operational Nonclassicality in Quantum Communication Networks

abstract: To quantify quantum advantage in communication networks, we apply an operational framework for witnessing quantum nonclassicality. Following previous approaches in the field, this framework first computes linear constraints on the input/output probabilities that arise in classical networks when the amount of communication is bounded. We then apply variational quantum algorithms to optimize these probabilities when quantum communication resources are introduced. Any violation of the classical constraints indicates that extra classical communication is needed to simulate the comparable quantum network, thereby demonstrating an explicit quantum advantage. We demonstrate nonclassicality in many basic networks such as entanglement-assisted point-to-point and multi-point channels. In all examples, we find that equipping classical or quantum channels with entanglement leads to nonclassicality, whereas networks having multiple senders do not require entanglement to achieve nonclassicality. Finally, we discuss how our approaches could be implemented on quantum networking hardware and used to automatically establish certain protocols.


title: Developments on frequency domain multiplexing readout for large arrays of transition-edge sensor X-ray micro-calorimeters

abstract: At SRON we have been developing X-ray TES micro-calorimeters as backup technology for the X-ray Integral Field Unit (X-IFU) of the Athena mission, demonstrating excellent resolving powers both under DC and AC bias. We also developed a frequency-domain multiplexing (FDM) readout technology, where each TES is coupled to a superconducting band-pass LC resonator and AC biased at MHz frequencies through a common readout line. The TES signals are summed at the input of a superconducting quantum interference device (SQUID), which performs a first amplification at cryogenic stage. Custom analog front-end electronics and digital boards take care of further amplifying the signals at room temperature and of the modulation/demodulation of the TES signals and bias carrier, respectively. We report on the most recent developments on our FDM technology, which involves a two-channel demonstration with a total of 70 pixels with a summed energy resolution of 2.34 +/- 0.02 eV at 5.9 keV without spectral performance degradation with respect to single-channel operation. Moreover, we discuss prospects towards the scaling-up to a larger multiplexing factor up to 78 pixels per channel in a 1-6 MHz readout bandwidth.


title: Data Augmentation using LLMs: Data Perspectives, Learning Paradigms and Challenges

abstract: In the rapidly evolving field of large language models (LLMs), data augmentation (DA) has emerged as a pivotal technique for enhancing model performance by diversifying training examples without the need for additional data collection. This survey explores the transformative impact of LLMs on DA, particularly addressing the unique challenges and opportunities they present in the context of natural language processing (NLP) and beyond. From both data and learning perspectives, we examine various strategies that utilize LLMs for data augmentation, including a novel exploration of learning paradigms where LLM-generated data is used for diverse forms of further training. Additionally, this paper highlights the primary open challenges faced in this domain, ranging from controllable data augmentation to multi-modal data augmentation. This survey highlights a paradigm shift introduced by LLMs in DA, and aims to serve as a comprehensive guide for researchers and practitioners.


title: MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer

abstract: Vision-Language Transformers (VLTs) have shown great success recently, but are meanwhile accompanied by heavy computation costs, where a major reason can be attributed to the large number of visual and language tokens. Existing token pruning research for compressing VLTs mainly follows a single-modality-based scheme yet ignores the critical role of aligning different modalities for guiding the token pruning process, causing the important tokens for one modality to be falsely pruned in another modality branch. Meanwhile, existing VLT pruning works also lack the flexibility to dynamically compress each layer based on different input samples. To this end, we propose a novel framework named Multimodal Alignment-Guided Dynamic Token Pruning (MADTP) for accelerating various VLTs. Specifically, we first introduce a well-designed Multi-modality Alignment Guidance (MAG) module that can align features of the same semantic concept from different modalities, to ensure the pruned tokens are less important for all modalities. We further design a novel Dynamic Token Pruning (DTP) module, which can adaptively adjust the token compression ratio in each layer based on different input instances. Extensive experiments on various benchmarks demonstrate that MADTP significantly reduces the computational complexity of kinds of multimodal models while preserving competitive performance. Notably, when applied to the BLIP model in the NLVR2 dataset, MADTP can reduce the GFLOPs by 80% with less than 4% performance degradation.


title: Adaptive Integrate-and-Fire Time Encoding Machine

abstract: An integrate-and-fire time-encoding machine (IF-TEM) is an effective asynchronous sampler that translates amplitude information into non-uniform time sequences. In this work, we propose a novel Adaptive IF-TEM (AIF-TEM) approach. This design dynamically adjusts the TEM's sensitivity to changes in the input signal's amplitude and frequency in real-time. We provide a comprehensive analysis of AIF-TEM's oversampling and distortion properties. By the adaptive adjustments, AIF-TEM as we show can achieve significant performance improvements in practical finite regime, in terms of sampling rate-distortion. We demonstrate empirically that in the scenarios tested AIF-TEM outperforms classical IF-TEM and traditional Nyquist (i.e., periodic) sampling methods for band-limited signals. In terms of Mean Square Error (MSE), the reduction reaches at least 12dB (fixing the oversampling rate).