title: Deriving Loss Function for Value-oriented Renewable Energy Forecasting

abstract: Renewable energy forecasting is the workhorse for efficient energy dispatch. However, forecasts with small mean squared errors (MSE) may not necessarily lead to low operation costs. Here, we propose a forecasting approach specifically tailored for operational purposes, by incorporating operational problems into the estimation of forecast models via designing a loss function. We formulate a bilevel program, where the operation problem is at the lower level, and the forecast model estimation is at the upper level. We establish the relationship between the lower-level optimal solutions and forecasts through multiparametric programming. By integrating it into the upper-level objective for minimizing expected operation cost, we convert the bilevel problem to a single-level one and derive the loss function for training the model. It is proved to be piecewise linear, for linear operation problem. Compared to the commonly used loss functions, e.g. MSE, our approach achieves lower operation costs.


title: Colloquial Persian POS (CPPOS) Corpus: A Novel Corpus for Colloquial Persian Part of Speech Tagging

abstract: Introduction: Part-of-Speech (POS) Tagging, the process of classifying words into their respective parts of speech (e.g., verb or noun), is essential in various natural language processing applications. POS tagging is a crucial preprocessing task for applications like machine translation, question answering, sentiment analysis, etc. However, existing corpora for POS tagging in Persian mainly consist of formal texts, such as daily news and newspapers. As a result, smart POS tools, machine learning models, and deep learning models trained on these corpora may not perform optimally for processing colloquial text in social network analysis. Method: This paper introduces a novel corpus, "Colloquial Persian POS" (CPPOS), specifically designed to support colloquial Persian text. The corpus includes formal and informal text collected from various domains such as political, social, and commercial on Telegram, Twitter, and Instagram more than 520K labeled tokens. After collecting posts from these social platforms for one year, special preprocessing steps were conducted, including normalization, sentence tokenizing, and word tokenizing for social text. The tokens and sentences were then manually annotated and verified by a team of linguistic experts. This study also defines a POS tagging guideline for annotating the data and conducting the annotation process. Results: To evaluate the quality of CPPOS, various deep learning models, such as the RNN family, were trained using the constructed corpus. A comparison with another well-known Persian POS corpus named "Bijankhan" and the Persian Hazm POS tool trained on Bijankhan revealed that our model trained on CPPOS outperforms them. With the new corpus and the BiLSTM deep neural model, we achieved a 14% improvement over the previous dataset.


title: Introduction to SQUID Sensors for Electronics Engineers

abstract: Flux transformers and superconducting quantum interference devices (SQUIDs) are two key superconducting devices used in the cutting-edge magnetic-field sensor systems, such as magnetocardiography (MCG) and magnetoencephalography (MEG). They are superconductor integrated circuits enabled by two superconductor elements, superconductor wire and Josephson junction, based on Meissner effect and Josephson effect. The principles of SQUID sensors are unfamiliar for electronics engineers who are trained with semiconductor electronics, due to the superconductor physics. We present an introduction to SQUID sensors, ranged from superconductor elements to the superconductor-semiconductor hybrid system. It is demonstrated that, SQUIDs inside are the resistor-inductor-capacitor (RLC) network driven by Josephson currents, and share the common network equation with normal RLC circuits; SQUID outside are magnetic-field-effect transistors (MFETs), and are dual to the semiconductor FETs in signal conversions; SQUID magnetic-field sensors are linear current amplifiers, as semiconductor FET electric-field sensors are linear voltage amplifiers.


title: YFlows: Systematic Dataflow Exploration and Code Generation for Efficient Neural Network Inference using SIMD Architectures on CPUs

abstract: We address the challenges associated with deploying neural networks on CPUs, with a particular focus on minimizing inference time while maintaining accuracy. Our novel approach is to use the dataflow (i.e., computation order) of a neural network to explore data reuse opportunities using heuristic-guided analysis and a code generation framework, which enables exploration of various Single Instruction, Multiple Data (SIMD) implementations to achieve optimized neural network execution. Our results demonstrate that the dataflow that keeps outputs in SIMD registers while also maximizing both input and weight reuse consistently yields the best performance for a wide variety of inference workloads, achieving up to 3x speedup for 8-bit neural networks, and up to 4.8x speedup for binary neural networks, respectively, over the optimized implementations of neural networks today.


title: Spin and orbital angular momenta of electromagnetic waves in classical and quantum electrodynamics

abstract: A plane, monochromatic electromagnetic wave propagating in free space can have a certain amount of spin angular momentum but cannot possess any orbital angular momentum. Even the spin angular momentum of the plane-wave is difficult to evaluate without resort to certain mathematical limit arguments. Both spin and orbital angular momenta can be computed for a wavepacket of finite duration and finite cross-sectional area using standard methods of classical electrodynamics. Extending these results to finite wavepackets in quantum electrodynamics requires subtle arguments in conjunction with the multimodal structure of the wavepacket. This paper presents some of the nuances of classical as well as quantum-optical methods for analyzing the spin and orbital angular momenta of electromagnetic waves.


title: GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length

abstract: The evolving sophistication and intricacies of Large Language Models (LLMs) yield unprecedented advancements, yet they simultaneously demand considerable computational resources and incur significant costs. To alleviate these challenges, this paper introduces a novel, simple, and effective method named ``\growlength'' to accelerate the pretraining process of LLMs. Our method progressively increases the training length throughout the pretraining phase, thereby mitigating computational costs and enhancing efficiency. For instance, it begins with a sequence length of 128 and progressively extends to 4096. This approach enables models to process a larger number of tokens within limited time frames, potentially boosting their performance. In other words, the efficiency gain is derived from training with shorter sequences optimizing the utilization of resources. Our extensive experiments with various state-of-the-art LLMs have revealed that models trained using our method not only converge more swiftly but also exhibit superior performance metrics compared to those trained with existing methods. Furthermore, our method for LLMs pretraining acceleration does not require any additional engineering efforts, making it a practical solution in the realm of LLMs.


title: Conceptual study of a two-layer silicon pixel detector to tag the passage of muons from cosmic sources through quantum processors

abstract: Recent studies in quantum computing have shown that quantum error correction with large numbers of physical qubits are limited by ionizing radiation from high-energy particles. Depending on the physical setup of the quantum processor, the contribution of muons from cosmic sources can constitute a significant fraction of these interactions. As most of these muons are difficult to stop, we perform a conceptual study of a two-layer silicon pixel detector to tag their hits on a solid-state quantum processor instead. With a typical dilution refrigerator geometry model, we find that efficiencies greater than 50% are most likely to be achieved if at least one of the layers is operated at the deep-cryogenic (<1 K) flanges of the refrigerator. Following this finding, we further propose a novel research program that could allow the development of silicon pixel detectors that are fast enough to provide input to quantum error correction algorithms, can operate at deep-cryogenic temperatures, and have very low power consumption.


title: Nine-year-old children outperformed ChatGPT in emotion: Evidence from Chinese writing

abstract: ChatGPT has been demonstrated to possess significant capabilities in generating intricate, human-like text, and recent studies have established that its performance in theory of mind tasks is comparable to that of a nine-year-old child. However, it remains uncertain whether ChatGPT surpasses nine-year-old children in Chinese writing proficiency. To explore this, our study juxtaposed the Chinese writing performance of ChatGPT and nine-year-old children on both narrative and scientific topics, aiming to uncover the relative strengths and weaknesses of ChatGPT in writing. The collected data were analyzed across five linguistic dimensions: fluency, accuracy, complexity, cohesion, and emotion. Each dimension underwent assessment through precise indices. The findings revealed that nine-year-old children excelled beyond ChatGPT in terms of fluency and cohesion within their writing. In contrast, ChatGPT manifested a superior performance in accuracy compared to the children. Concerning complexity, children exhibited superior skills in science-themed writing, while ChatGPT prevailed in nature-themed writing. Significantly, this research is pioneering in revealing that nine-year-old children convey stronger emotions than ChatGPT in their Chinese compositions.


title: Permutation orbifolds of vertex operator superalgebra and associative algebras

abstract: Let $V$ be a vertex operator superalgebra and $g=\left(1\ 2\ \cdots k\right)$ be a $k$-cycle which is viewed as an automorphism of the tensor product vertex operator superalgebra $V^{\otimes k}$. In this paper, we construct an explicit isomorphism from $A_{g}\left(V^{\otimes k}\right)$ to $A\left(V\right)$ if $k$ is odd and to $A_{\sigma}\left(V\right)$ if $k$ is even where $\sigma$ is the canonical automorphism of $V$ of order 2 determined by the superspace structure of $V.$ These recover previous results by Barron and Barron-Werf that there is a one-to-one correspondence between irreducible $g$-twisted $V^{\otimes k}$-modules and irreducible $V$-modules (resp. irreducible $\sigma$-twisted $V$-modules) when $k$ is odd (resp. even). This explicit isomorphism is expected to be useful in our further study on the Zhu algebra of fixed point subalgebra.


title: Lollipop and Cubic Weight Functions for Graph Pebbling

abstract: Given a configuration of pebbles on the vertices of a graph $G$, a pebbling move removes two pebbles from a vertex and puts one pebble on an adjacent vertex. The pebbling number of a graph $G$ is the smallest number of pebbles required such that, given an arbitrary initial configuration of pebbles, one pebble can be moved to any vertex of $G$ through some sequence of pebbling moves. Through constructing a non-tree weight function for $Q_4$, we improve the weight function technique, introduced by Hurlbert and extended by Cranston et al., that gives an upper bound for the pebbling number of graphs. Then, we propose a conjecture on weight functions for the $n$-dimensional cube. We also construct a set of valid weight functions for variations of lollipop graphs, extending previously known constructions.


title: Nuclear Induction Lineshape: Non-Markovian Diffusion with Boundaries

abstract: The dynamics of viscoelastic fluids are governed by a memory function, essential yet challenging to compute, especially when diffusion faces boundary restrictions. We propose a computational method that captures memory effects by analyzing the time-correlation function of the pressure tensor, a viscosity indicator, through the Stokes-Einstein equation's analytic continuation into the Laplace domain. We integrate this equation with molecular dynamics (MD) simulations to derive necessary parameters. Our approach computes NMR lineshapes using a generalized diffusion coefficient, accounting for temperature and confinement geometry. This method directly links the memory function with thermal transport parameters, facilitating accurate NMR signal computation for non-Markovian fluids in confined geometries.


title: Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs

abstract: Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities in various multi-modal tasks. Nevertheless, their performance in fine-grained image understanding tasks is still limited. To address this issue, this paper proposes a new framework to enhance the fine-grained image understanding abilities of MLLMs. Specifically, we present a new method for constructing the instruction tuning dataset at a low cost by leveraging annotations in existing datasets. A self-consistent bootstrapping method is also introduced to extend existing dense object annotations into high-quality referring-expression-bounding-box pairs. These methods enable the generation of high-quality instruction data which includes a wide range of fundamental abilities essential for fine-grained image perception. Moreover, we argue that the visual encoder should be tuned during instruction tuning to mitigate the gap between full image perception and fine-grained image perception. Experimental results demonstrate the superior performance of our method. For instance, our model exhibits a 5.2% accuracy improvement over Qwen-VL on GQA and surpasses the accuracy of Kosmos-2 by 24.7% on RefCOCO_val. We have also attained the top rank on the leaderboard of MMBench. This promising performance is achieved by training on only publicly available data, making it easily reproducible. The models, datasets, and codes are publicly available at https://github.com/SY-Xuan/Pink.


title: City Foundation Models for Learning General Purpose Representations from OpenStreetMap

abstract: Pre-trained Foundation Models (PFMs) have ushered in a paradigm-shift in Artificial Intelligence, due to their ability to learn general-purpose representations that can be readily employed in a wide range of downstream tasks. While PFMs have been successfully adopted in various fields such as Natural Language Processing and Computer Vision, their capacity in handling geospatial data and answering urban questions remains limited. This can be attributed to the intrinsic heterogeneity of geospatial data, which encompasses different data types, including points, segments and regions, as well as multiple information modalities, such as a spatial position, visual characteristics and textual annotations. The proliferation of Volunteered Geographic Information initiatives, and the ever-increasing availability of open geospatial data sources, like OpenStreetMap, which is freely accessible globally, unveil a promising opportunity to bridge this gap. In this paper, we present CityFM, a self-supervised framework to train a foundation model within a selected geographical area of interest, such as a city. CityFM relies solely on open data from OSM, and produces multimodal representations of entities of different types, incorporating spatial, visual, and textual information. We analyse the entity representations generated using our foundation models from a qualitative perspective, and conduct quantitative experiments on road, building, and region-level downstream tasks. We compare its results to algorithms tailored specifically for the respective applications. In all the experiments, CityFM achieves performance superior to, or on par with, the baselines.


title: Unravelling the Post-Collision Properties of the Cartwheel Galaxy: A MUSE Exploration of its Bar and Inner Region

abstract: Aims: To investigate the characteristics of the bar and inner disk in the collisional ring galaxy Cartwheel. Methods: We used the Integral Field Unit (IFU) observations with Multi-Unit Spectroscopic Explorer (MUSE) of the Very Large Telescope (VLT) to investigate the stellar kinematics, age, and nature of ionised gas in the inner region of the Cartwheel. We produced the stellar line of sight (LOS) velocity (V), velocity dispersion ($\sigma$), h$_3$ velocity moment, stellar population age, and emission-line maps of the galaxy using the Galaxy IFU Spectroscopy Tool (GIST) pipeline. Results: The observed nature of intensity, V, and $\sigma$ profiles altogether support the existence of a stellar bar as earlier revealed from near-infrared (NIR) $K_s$ band imaging. A weak correlation between V/$\sigma$ and h$_3$ is found within the bar radius, providing more kinematic evidence for a stellar bar which survived the drop-through collision. The overall weak anti-correlation between V/$\sigma$ and h$_3$ in the disk implies that the stellar orbits in the disk are less stable, which might be due to the impact of the collision. The mass-weighted age map of the galaxy shows that the stellar populations in the bar region are relatively older, with an increasing gradient from the bar edge to the centre, another evidence to signify that the bar was present before the galaxy underwent collision. We do not find an active galactic nuclei (AGN) from the BPT analysis of a central unresolved source reported earlier using NIR imaging. Our findings provide the preservation of the pre-collisional structures in the inner region of the Cartwheel, an important input to understanding the evolution of collisional galaxy systems, particularly investigating the pre-collisional central region for theoretical studies.


title: Quantum generative adversarial learning in photonics

abstract: Quantum Generative Adversarial Networks (QGANs), an intersection of quantum computing and machine learning, have attracted widespread attention due to their potential advantages over classical analogs. However, in the current era of Noisy Intermediate-Scale Quantum (NISQ) computing, it is essential to investigate whether QGANs can perform learning tasks on near-term quantum devices usually affected by noise and even defects. In this Letter, using a programmable silicon quantum photonic chip, we experimentally demonstrate the QGAN model in photonics for the first time, and investigate the effects of noise and defects on its performance. Our results show that QGANs can generate high-quality quantum data with a fidelity higher than 90\%, even under conditions where up to half of the generator's phase shifters are damaged, or all of the generator and discriminator's phase shifters are subjected to phase noise up to 0.04$\pi$. Our work sheds light on the feasibility of implementing QGANs on NISQ-era quantum hardware.

categories: quant-ph cs.AI cs.ET cs.LG physics.optics


title: On the Observables of Renormalizable Interactions

abstract: We reconsider the renormalization of scalar mass and point out that the quantum correction to the physical observable, as opposed to the bare parameter, of a renormalizable operator, is technically insensitive to ultraviolet physics and independent of the regularization scheme. It is expressed as the difference in the same quantities at different energy scales, maintaining the same asymptotics. Thus, any sensible regularization cancels out the divergences, including the quadratic ones, and yields the same finite corrections. To this end, we first show that the vacuum polarization of quantum electrodynamics is independent of the regularization scheme and a gauge-dependent quadratic divergence is canceled in the observable. We then calculate the quantum correction to the Higgs mass squared by the top-quark loop. It is again finite and regularization-scheme independent. For large external momentum, the correction of the pole mass-squared is dominated by power running, resulting in an order of 0.1 percent correction. In particular, the effect of heavy fields on the scalar mass correction is suppressed.


title: Mechatronic Generation of Datasets for Acoustics Research

abstract: We address the challenge of making spatial audio datasets by proposing a shared mechanized recording space that can run custom acoustic experiments: a Mechatronic Acoustic Research System (MARS). To accommodate a wide variety of experiments, we implement an extensible architecture for wireless multi-robot coordination which enables synchronized robot motion for dynamic scenes with moving speakers and microphones. Using a virtual control interface, we can remotely design automated experiments to collect large-scale audio data. This data is shown to be similar across repeated runs, demonstrating the reliability of MARS. We discuss the potential for MARS to make audio data collection accessible for researchers without dedicated acoustic research spaces.


title: Active Anomaly Detection in Confined Spaces Using Ergodic Traversal of Directed Region Graphs

abstract: We provide the first step toward developing a hierarchical control-estimation framework to actively plan robot trajectories for anomaly detection in confined spaces. The space is represented globally using a directed region graph, where a region is a landmark that needs to be visited (inspected). We devise a fast mixing Markov chain to find an ergodic route that traverses this graph so that the region visitation frequency is proportional to its anomaly detection uncertainty, while satisfying the edge directionality (region transition) constraint(s). Preliminary simulation results show fast convergence to the ergodic solution and confident estimation of the presence of anomalies in the inspected regions.


title: Structural Controllability of Bilinear Systems on $\mathbb{SE(n)}$

abstract: Structural controllability challenges arise from imprecise system modeling and system interconnections in large scale systems. In this paper, we study structural control of bilinear systems on the special Euclidean group. We employ graph theoretic methods to analyze the structural controllability problem for driftless bilinear systems and structural accessibility for bilinear systems with drift. This facilitates the identification of a sparsest pattern necessary for achieving structural controllability and discerning redundant connections. To obtain a graph theoretic characterization of structural controllability and accessibility on the special Euclidean group, we introduce a novel idea of solid and broken edges on graphs; subsequently, we use the notion of transitive closure of graphs.


title: Chiral phase modulation and tunable broadband perfect absorber using the coherent cold atomic ensemble

abstract: We investigate the two-channel nonreciprocal scattering of a coherent atomic ensemble under the linear spatial Kramers-Kronig modulation, which has potential applications in chiral phase modulation and broadband coherent perfect/asymmetric absorber that yet is typically unavailable in conventional continuous atomic media. In the regime of electromagnetically induced transparency, we observe the direction-dependent (chiral) phase modulation, which may enrich the burgeoning chiral quantum optics and can be used for implementing photonic filters, unidirectional amplifiers, and coherent asymmetric absorbers. By simplifying the stringent generation condition of coherent perfect absorption (CPA), we demonstrate the possibility of realizing two-channel CPA with broadband and sharp edges. Our proposal may be used to design and integrate some all-optical functional devices at extremely low power levels for quantum information processing and optical communication networks.


title: On the Core-Collapse Supernova Explanation for LAMOST J1010+2358

abstract: Low-metallicity very massive stars with an initial mass of $\sim 140$--$260\, {\rm M_\odot}$ are expected to end their lives as pair-instability supernovae (PISNe). The abundance pattern resulting from a PISN differs drastically from regular core-collapse supernova (CCSN) models and is expected to be seen in very metal-poor (VMP) stars of ${\rm[Fe/H]}\lesssim -2$. Despite the routine discovery of many VMP stars, the unique abundance pattern expected from PISNe has not been unambiguously detected. The recently discovered VMP star LAMOST J1010+2358, however, shows a peculiar abundance pattern that is remarkably well fit by a PISN, indicating the potential first discovery of a bonafide star born from gas polluted by a PISN. In this paper, we study the detailed nucleosynthesis in a large set of models of CCSN of Pop III and Pop II star of metallicity ${\rm[Fe/H]}=-3$ with masses ranging from $12$--$30\,{\rm M_\odot}$. We find that the observed abundance pattern in LAMOST J1010+2358 can be fit at least equally well by CCSN models of $\sim 12$--$14\,{\rm M_\odot}$ that undergo negligible fallback following the explosion. The best-fit CCSN models provide a fit that is even marginally better than the best-fit PISN model. We conclude the measured abundance pattern in LAMOST J1010+2358 could have originated from a CCSN and therefore cannot be unambiguously identified with a PISN given the set of elements measured in it to date. We identify key elements that need to be measured in future detections in stars like LAMOST J1010+2358 that can differentiate between CCSN and PISN origin.


title: Nearest neighbor synthesis of CNOT circuits on general quantum architectures

abstract: In recent years, quantum computing has entered the Noisy Intermediate-Scale Quantum (NISQ). However, NISQ devices have inherent limitations in terms of connectivity and hardware noise, necessitating the transformation of quantum logic circuits for correct execution on NISQ chips. The synthesis of CNOT circuits considering physical constraints can transform quantum algorithms into low-level quantum circuits, which can be directly executed on physical chips. In the current trend, quantum chip architectures without Hamiltonian paths are gradually replacing architectures with Hamiltonian paths due to their scalability and low-noise characteristics. To this end, this paper addresses the nearest neighbor synthesis of CNOT circuits in the architecture with and without Hamiltonian paths, aiming to enhance the fidelity of the circuits after execution. Firstly, a key-qubit priority mapping model for the general architecture with and without Hamiltonian paths is proposed. Secondly, the initial mapping is further improved by using tabu search to reduce the number of CNOT gates after circuit synthesis and enhance its fidelity. Finally, the noise-aware CNOT circuit nearest neighbor synthesis algorithm for the general architecture is proposed based on the key-qubit priority mapping model. Experimental results show that the proposed method can enhance the fidelity of the CNOT circuit by about 64.7% on a real quantum computing device, achieving a significant optimization effect. Furthermore, the method can be extended to other circuits, thereby improving the overall performance of quantum computing on NISQ devices.


title: Nonlinear Multi-Carrier System with Signal Clipping: Measurement, Analysis, and Optimization

abstract: Signal clipping is a classic technique for reducing peak-to-average power ratio (PAPR) in orthogonal frequency division multiplexing (OFDM) systems. It has been widely applied in consumer electronic devices owing to its low complexity and high efficiency. Although clipping reduces the nonlinear distortion caused by power amplifiers (PAs), it induces additional clipping distortion. Optimizing the joint system performance with consideration of both PA nonlinearity and clipping distortion remains an open problem due to the complex PA modeling. In this paper, we analyze the PA nonlinearity through the Bessel-Fourier PA (BFPA) model and simplify its power expression using inter-modulation product (IMP) analysis. We derive expressions of the receiver signal-to-noise ratio (SNR) and system symbol error rate (SER) for the nonlinear clipped OFDM system. With the derivations, we investigate the optimal system setting to achieve the SER lower bound in a practical OFDM system that considers both PA nonlinearity and clipping distortion. The methods and results presented in this paper can serve as a useful reference for the system-level optimization of clipped OFDM systems with nonlinear PA.


title: Performance evaluation of Machine learning algorithms for Intrusion Detection System

abstract: The escalation of hazards to safety and hijacking of digital networks are among the strongest perilous difficulties that must be addressed in the present day. Numerous safety procedures were set up to track and recognize any illicit activity on the network's infrastructure. IDS are the best way to resist and recognize intrusions on internet connections and digital technologies. To classify network traffic as normal or anomalous, Machine Learning (ML) classifiers are increasingly utilized. An IDS with machine learning increases the accuracy with which security attacks are detected. This paper focuses on intrusion detection systems (IDSs) analysis using ML techniques. IDSs utilizing ML techniques are efficient and precise at identifying network assaults. In data with large dimensional spaces, however, the efficacy of these systems degrades. correspondingly, the case is essential to execute a feasible feature removal technique capable of getting rid of characteristics that have little effect on the classification process. In this paper, we analyze the KDD CUP-'99' intrusion detection dataset used for training and validating ML models. Then, we implement ML classifiers such as Logistic Regression, Decision Tree, K-Nearest Neighbour, Naive Bayes, Bernoulli Naive Bayes, Multinomial Naive Bayes, XG-Boost Classifier, Ada-Boost, Random Forest, SVM, Rocchio classifier, Ridge, Passive-Aggressive classifier, ANN besides Perceptron (PPN), the optimal classifiers are determined by comparing the results of Stochastic Gradient Descent and back-propagation neural networks for IDS, Conventional categorization indicators, such as "accuracy, precision, recall, and the f1-measure, have been used to evaluate the performance of the ML classification algorithms.


title: 3D-Printed Micro Ion Trap Technology for Scalable Quantum Information Processing

abstract: Trapped-ion applications, such as in quantum information, precision measurements, optical clocks, and mass spectrometry, rely on specialized high-performance ion traps. The latter applications typically employ traditional machining to customize macroscopic 3D Paul traps, while quantum information processing experiments usually rely on photo-lithographic techniques to miniaturize the traps and meet scalability requirements. Using photolithography, however, it is challenging to fabricate the complex three-dimensional electrode structures required for optimal confinement. Here we address these limitations by adopting a high-resolution 3D printing technology based on two-photon polymerization supporting fabrication of large arrays of high-performance miniaturized 3D traps. We show that 3D-printed ion traps combine the advantages of traditionally machined 3D traps with the miniaturization provided by photolithography by confining single calcium ions in a small 3D-printed ion trap with radial trap frequencies ranging from 2 MHz to 24 MHz. The tight confinement eases ion cooling requirements and allows us to demonstrate high-fidelity coherent operations on an optical qubit after only Doppler cooling. With 3D printing technology, the design freedom is drastically expanded without sacrificing scalability and precision so that ion trap geometries can be optimized for higher performance and better functionality.


title: Radio Plateaus in Gamma-Ray Burst Afterglows and Their Application in Cosmology

abstract: The plateau phase in the radio afterglows has been observed in very few gamma-ray bursts (GRBs), and 27 radio light curves with plateau phase were acquired from the published literature in this article. We obtain the related parameters of the radio plateau, such as temporal indexes during the plateau phase ($\alpha_1$ and $\alpha_2$), break time ($\Tbz$) and the corresponding radio flux ($F_{\rm b}$). The two parameter Dainotti relation between the break time of the plateau and the corresponding break luminosity ($\Lbz$) in radio band is $\Lbz \propto \Tbz^{-1.20\pm0.24}$. Including the isotropic energy $\Eiso$ and the peak energy $\Epi$, the three parameter correlations for the radio plateaus are written as $\Lbz \propto \Tbz^{-1.01 \pm 0.24} \Eiso^{0.18 \pm 0.09}$ and $\Lbz \propto \Tbz^{-1.18 \pm 0.27} \Epi^{0.05 \pm 0.28}$, respectively. The correlations are less consistent with that of X-ray and optical plateaus, implying that radio plateaus may have a different physical mechanism. The typical frequencies crossing the observational band may be a reasonable hypothesis that causes the breaks of the radio afterglows. We calibrate GRBs empirical luminosity correlations as standard candle for constraining cosmological parameters, and find that our samples can constrain the flat $\Lambda$CDM model well, while are not sensitive to non-flat ${\Lambda}$CDM model. By combining GRBs with other probes, such as SN and CMB, the constraints on cosmological parameters are $\om = 0.297\pm0.006$ for the flat ${\Lambda}$CDM model and $\om = 0.283\pm0.008$, $\oL = 0.711\pm0.006$ for the non-flat ${\Lambda}$CDM model, respectively.


title: A Task-oriented Dialog Model with Task-progressive and Policy-aware Pre-training

abstract: Pre-trained conversation models (PCMs) have achieved promising progress in recent years. However, existing PCMs for Task-oriented dialog (TOD) are insufficient for capturing the sequential nature of the TOD-related tasks, as well as for learning dialog policy information. To alleviate these problems, this paper proposes a task-progressive PCM with two policy-aware pre-training tasks. The model is pre-trained through three stages where TOD-related tasks are progressively employed according to the task logic of the TOD system. A global policy consistency task is designed to capture the multi-turn dialog policy sequential relation, and an act-based contrastive learning task is designed to capture similarities among samples with the same dialog policy. Our model achieves better results on both MultiWOZ and In-Car end-to-end dialog modeling benchmarks with only 18\% parameters and 25\% pre-training data compared to the previous state-of-the-art PCM, GALAXY.


title: A Novel Computational and Modeling Foundation for Automatic Coherence Assessment

abstract: Coherence is an essential property of well-written texts, that refers to the way textual units relate to one another. In the era of generative AI, coherence assessment is essential for many NLP tasks; summarization, generation, long-form question-answering, and more. However, in NLP {coherence} is an ill-defined notion, not having a formal definition or evaluation metrics, that would allow for large-scale automatic and systematic coherence assessment. To bridge this gap, in this work we employ the formal linguistic definition of \citet{Reinhart:1980} of what makes a discourse coherent, consisting of three conditions -- {\em cohesion, consistency} and {\em relevance} -- and formalize these conditions as respective computational tasks. We hypothesize that (i) a model trained on all of these tasks will learn the features required for coherence detection, and that (ii) a joint model for all tasks will exceed the performance of models trained on each task individually. On two benchmarks for coherence scoring rated by humans, one containing 500 automatically-generated short stories and another containing 4k real-world texts, our experiments confirm that jointly training on the proposed tasks leads to better performance on each task compared with task-specific models, and to better performance on assessing coherence overall, compared with strong baselines. We conclude that the formal and computational setup of coherence as proposed here provides a solid foundation for advanced methods of large-scale automatic assessment of coherence.


title: Approximate filtering via discrete dual processes

abstract: We consider the task of filtering a dynamic parameter evolving as a diffusion process, given data collected at discrete times from a likelihood which is conjugate to the marginal law of the diffusion, when a generic dual process on a discrete state space is available. Recently, it was shown that duality with respect to a death-like process implies that the filtering distributions are finite mixtures, making exact filtering and smoothing feasible through recursive algorithms with polynomial complexity in the number of observations. Here we provide general results for the case of duality between the diffusion and a regular jump continuous-time Markov chain on a discrete state space, which typically leads to filtering distribution given by countable mixtures indexed by the dual process state space. We investigate the performance of several approximation strategies on two hidden Markov models driven by Cox-Ingersoll-Ross and Wright-Fisher diffusions, which admit duals of birth-and-death type, and compare them with the available exact strategies based on death-type duals and with bootstrap particle filtering on the diffusion state space as a general benchmark.


title: On the Complexity of the Eigenvalue Deletion Problem

abstract: For any fixed positive integer $r$ and a given budget $k$, the $r$-\textsc{Eigenvalue Vertex Deletion} ($r$-EVD) problem asks if a graph $G$ admits a subset $S$ of at most $k$ vertices such that the adjacency matrix of $G\setminus S$ has at most $r$ distinct eigenvalues. The edge deletion, edge addition, and edge editing variants are defined analogously. For $r = 1$, $r$-EVD is equivalent to the Vertex Cover problem. For $r = 2$, it turns out that $r$-EVD amounts to removing a subset $S$ of at most $k$ vertices so that $G\setminus S$ is a cluster graph where all connected components have the same size. We show that $r$-EVD is NP-complete even on bipartite graphs with maximum degree four for every fixed $r > 2$, and FPT when parameterized by the solution size and the maximum degree of the graph. We also establish several results for the special case when $r = 2$. For the vertex deletion variant, we show that $2$-EVD is NP-complete even on triangle-free and $3d$-regular graphs for any $d\geq 2$, and also NP-complete on $d$-regular graphs for any $d\geq 8$. The edge deletion, addition, and editing variants are all NP-complete for $r = 2$. The edge deletion problem admits a polynomial time algorithm if the input is a cluster graph, while the edge addition variant is hard even when the input is a cluster graph. We show that the edge addition variant has a quadratic kernel. The edge deletion and vertex deletion variants are FPT when parameterized by the solution size alone. Our main contribution is to develop the complexity landscape for the problem of modifying a graph with the aim of reducing the number of distinct eigenvalues in the spectrum of its adjacency matrix. It turns out that this captures, apart from Vertex Cover, also a natural variation of the problem of modifying to a cluster graph as a special case, which we believe may be of independent interest.


title: Upper bounds for the number of number fields with prescribed Galois group

abstract: Let $n$ be a positive integer and $G$ be a transitive permutation subgroup of $S_n$. Given a number field $K$ with $[K:\mathbb{Q}]=n$, we let $\widetilde{K}$ be its Galois closure over $\mathbb{Q}$ and refer to $Gal(\widetilde{K}/\mathbb{Q})$ as its Galois group. We may identify this Galois group with a transitive subgroup of $S_n$. Given a real number $X>0$, we set $N_{n}(X;G)$ to be the number of such number fields $K$ for which the absolute discriminant is bounded above by $X$, and for which $Gal(\widetilde{K}/\mathbb{Q})$ is isomorphic to $G$ as a permutation subgroup of $S_n$. We prove an asymptotic upper bound for $N_n(X;G)$ as $X\rightarrow\infty$. This result is conditional and based upon the non-vanishing of certain polynomial determinants in $n$-variables. We expect that these determinants are non-vanishing for many groups, and demonstrate through some examples how they may be computed.


title: Wavelet Scattering Transform for Improving Generalization in Low-Resourced Spoken Language Identification

abstract: Commonly used features in spoken language identification (LID), such as mel-spectrogram or MFCC, lose high-frequency information due to windowing. The loss further increases for longer temporal contexts. To improve generalization of the low-resourced LID systems, we investigate an alternate feature representation, wavelet scattering transform (WST), that compensates for the shortcomings. To our knowledge, WST is not explored earlier in LID tasks. We first optimize WST features for multiple South Asian LID corpora. We show that LID requires low octave resolution and frequency-scattering is not useful. Further, cross-corpora evaluations show that the optimal WST hyper-parameters depend on both train and test corpora. Hence, we develop fused ECAPA-TDNN based LID systems with different sets of WST hyper-parameters to improve generalization for unknown data. Compared to MFCC, EER is reduced upto 14.05% and 6.40% for same-corpora and blind VoxLingua107 evaluations, respectively.


title: Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals

abstract: Causal explanations of the predictions of NLP systems are essential to ensure safety and establish trust. Yet, existing methods often fall short of explaining model predictions effectively or efficiently and are often model-specific. In this paper, we address model-agnostic explanations, proposing two approaches for counterfactual (CF) approximation. The first approach is CF generation, where a large language model (LLM) is prompted to change a specific text concept while keeping confounding concepts unchanged. While this approach is demonstrated to be very effective, applying LLM at inference-time is costly. We hence present a second approach based on matching, and propose a method that is guided by an LLM at training-time and learns a dedicated embedding space. This space is faithful to a given causal graph and effectively serves to identify matches that approximate CFs. After showing theoretically that approximating CFs is required in order to construct faithful explanations, we benchmark our approaches and explain several models, including LLMs with billions of parameters. Our empirical results demonstrate the excellent performance of CF generation models as model-agnostic explainers. Moreover, our matching approach, which requires far less test-time resources, also provides effective explanations, surpassing many baselines. We also find that Top-K techniques universally improve every tested method. Finally, we showcase the potential of LLMs in constructing new benchmarks for model explanation and subsequently validate our conclusions. Our work illuminates new pathways for efficient and accurate approaches to interpreting NLP systems.


title: Path Structured Multimarginal Schr\"odinger Bridge for Probabilistic Learning of Hardware Resource Usage by Control Software

abstract: The solution of the path structured multimarginal Schr\"{o}dinger bridge problem (MSBP) is the most-likely measure-valued trajectory consistent with a sequence of observed probability measures or distributional snapshots. We leverage recent algorithmic advances in solving such structured MSBPs for learning stochastic hardware resource usage by control software. The solution enables predicting the time-varying distribution of hardware resource availability at a desired time with guaranteed linear convergence. We demonstrate the efficacy of our probabilistic learning approach in a model predictive control software execution case study. The method exhibits rapid convergence to an accurate prediction of hardware resource utilization of the controller. The method can be broadly applied to any software to predict cyber-physical context-dependent performance at arbitrary time.


title: The Generalized Matrix Norm Problem

abstract: We study the computability of the operator norm of a matrix with respect to norms induced by linear operators. Our findings reveal that this problem can be solved exactly in polynomial time in certain situations, and we discuss how it can be approximated for other cases. Along the way, we investigate the concept of push-forward and pull-back of seminorms, which leads us to uncover novel duality principles that come into play when optimizing over the unit ball of norms.


title: A semi-Lagrangian $\epsilon$-monotone Fourier method for continuous withdrawal GMWBs under jump-diffusion with stochastic interest rate

abstract: We develop an efficient pricing approach for guaranteed minimum withdrawal benefits (GMWBs) with continuous withdrawals under a realistic modeling setting with jump-diffusions and stochastic interest rate. Utilizing an impulse stochastic control framework, we formulate the no-arbitrage GMWB pricing problem as a time-dependent Hamilton-Jacobi-Bellman (HJB) Quasi-Variational Inequality (QVI) having three spatial dimensions with cross derivative terms. Through a novel numerical approach built upon a combination of a semi-Lagrangian method and the Green's function of an associated linear partial integro-differential equation, we develop an $\epsilon$-monotone Fourier pricing method, where $\epsilon > 0$ is a monotonicity tolerance. Together with a provable strong comparison result for the HJB-QVI, we mathematically demonstrate convergence of the proposed scheme to the viscosity solution of the HJB-QVI as $\epsilon \to 0$. We present a comprehensive study of the impact of simultaneously considering jumps in the sub-account process and stochastic interest rate on the no-arbitrage prices and fair insurance fees of GMWBs, as well as on the holder's optimal withdrawal behaviors.


title: On the Onset of Robust Overfitting in Adversarial Training

abstract: Adversarial Training (AT) is a widely-used algorithm for building robust neural networks, but it suffers from the issue of robust overfitting, the fundamental mechanism of which remains unclear. In this work, we consider normal data and adversarial perturbation as separate factors, and identify that the underlying causes of robust overfitting stem from the normal data through factor ablation in AT. Furthermore, we explain the onset of robust overfitting as a result of the model learning features that lack robust generalization, which we refer to as non-effective features. Specifically, we provide a detailed analysis of the generation of non-effective features and how they lead to robust overfitting. Additionally, we explain various empirical behaviors observed in robust overfitting and revisit different techniques to mitigate robust overfitting from the perspective of non-effective features, providing a comprehensive understanding of the robust overfitting phenomenon. This understanding inspires us to propose two measures, attack strength and data augmentation, to hinder the learning of non-effective features by the neural network, thereby alleviating robust overfitting. Extensive experiments conducted on benchmark datasets demonstrate the effectiveness of the proposed methods in mitigating robust overfitting and enhancing adversarial robustness.


title: Skip-Plan: Procedure Planning in Instructional Videos via Condensed Action Space Learning

abstract: In this paper, we propose Skip-Plan, a condensed action space learning method for procedure planning in instructional videos. Current procedure planning methods all stick to the state-action pair prediction at every timestep and generate actions adjacently. Although it coincides with human intuition, such a methodology consistently struggles with high-dimensional state supervision and error accumulation on action sequences. In this work, we abstract the procedure planning problem as a mathematical chain model. By skipping uncertain nodes and edges in action chains, we transfer long and complex sequence functions into short but reliable ones in two ways. First, we skip all the intermediate state supervision and only focus on action predictions. Second, we decompose relatively long chains into multiple short sub-chains by skipping unreliable intermediate actions. By this means, our model explores all sorts of reliable sub-relations within an action sequence in the condensed action space. Extensive experiments show Skip-Plan achieves state-of-the-art performance on the CrossTask and COIN benchmarks for procedure planning.


title: Gluon TMDs from J/$\psi$ production in longitudinally polarized deeply inelastic scattering

abstract: We investigate the feasibility of exploring the gluon transverse-momentum-dependent distribution functions (TMDs) inside a longitudinally polarized nucleon. We utilize quarkonium production via the color-octet mechanism combined with TMD formalism in semi-inclusive deeply inelastic scattering (SIDIS) at low transverse momentum as a tool to access polarized gluon TMDs. The corresponding cross-section of the process is expressed in terms of gluon TMDs and non-relativistic QCD matrix elements. We provide the expressions for the $\sin2\phi$ azimuthal asymmetries of $J/\psi$ production in SIDIS with a unpolarized beam colliding on longitudinally polarized nucleon. The asymmetry is contributed by the time-reversal-odd gluon TMD $h_{1L}^{\perp \,g}(x,\boldsymbol{p}_T^2)$. The maximum possible asymmetry deduced from the positivity bound is sizable and could be measured. We also estimate the double longitudinal spin asymmetry $A_{LL}$ of $J/\psi$ production using a spectator model result for $g_{1L}^g(x,\boldsymbol{p}_T^2)$.


title: In-plane Tidal Disruption of Stars in Disks of Active Galactic Nuclei

abstract: Stars embedded in active galactic nucleus (AGN) disks or captured by them may scatter onto the supermassive black hole (SMBH), leading to a tidal disruption event (TDE). Using the moving-mesh hydrodynamics simulations with {\small AREPO}, we investigate the dependence of debris properties in in-plane TDEs in AGN disks on the disk density and the orientation of stellar orbits relative to the disk gas (pro- and retro-grade). Key findings are: 1) Debris experiences continuous perturbations from the disk gas, which can result in significant and continuous changes in debris energy and angular momentum compared to `naked' TDEs. 2) Above a critical density of a disk around a SMBH with mass $M_{\bullet}$ ($\rho_{\rm crit} \sim 10^{-8}{\rm g~cm^{-3}}(M_{\bullet}/10^{6}{\rm M}_{\odot})^{-2.5}$) for retrograde stars, both bound and unbound debris is fully mixed into the disk. The density threshold for no bound debris return, inhibiting the accretion component of TDEs, is $\rho_{\rm crit,bound} \sim 10^{-9}{\rm g~cm^{-3}}(M_{\bullet}/10^{6}{\rm M}_{\odot})^{-2.5}$. 3) Observationally, AGN-TDEs transition from resembling naked TDEs in the limit of $\rho_{\rm disk}\lesssim 10^{-2}\rho_{\rm crit,bound}$ to fully muffled TDEs with associated inner disk state changes at $\rho_{\rm disk}\gtrsim\rho_{\rm crit,bound}$, with a superposition of AGN+TDE in between. Stellar or remnant passages themselves can significantly perturb the inner disk. This can lead to an immediate X-ray signature and optically detectable inner disk state changes, potentially contributing to the changing-look AGN phenomenon. 4) Debris mixing can enriches the average disk metallicity over time if the star's metallicity exceeds that of the disk gas.


title: DFT aided prediction of phase stability, optoelectronic and thermoelectric properties of A2AuScX6 (A= Cs, Rb; X= Cl, Br, I) double perovskites for energy harvesting technology

abstract: In this work, density functional theory (DFT) is used to find out the ground state structures of A2AuScX6 (A= Cs, Rb; X= Cl, Br, I) double Perovskite (DP) halides for the first time. The DP A2AuScX6 halides were studied for their structural phase stability and optoelectronic properties in order to identify potential materials for energy harvesting systems. The stability criteria were verified by computing the formation energy, binding energy, phonon dispersion curve, stiffness constants, tolerance, and octahedral factors. The electronic band structure, carrier effective mass, density of states (DOS), and charge density distribution were calculated to reveal the nature of electronic conductivity and the chemical bonding nature present within them. For Cs2AuScX6 (Rb2AuScX6) [X = Cl, Br, I], the corresponding values of band gap [using TB-mBJ] are 1.88 (1.93), 1.68 (1.71), and 1.30 (1.32) eV. The optical constants (dielectric function, absorption coefficient, refractive index, energy loss function, photoconductivity, and reflectivity) were also calculated to get more insights into their electronic nature. For Cs2AuScX6 (Rb2AuScX6) [X = Cl, Br, I], the absorption coefficient in the visible range are 3.33 (3.45) 105 cm-1, 2.70 (2.81) 105 cm-1, and 2.13 (2.18) 105 cm-1, respectively. We also investigated the thermoelectric properties to predict promising applications in thermoelectric devices. Our calculations revealed high ZT values of 0.92, 1.07, and 1.06 for Cs2AuScX6 (X = Cl, Br, I) and 0.97, 0.99, and 1.01 for Rb2AuScX6 (X = Cl, Br, I) at 300 K. To further aid in predicting any novel materials, routine research was also done on the thermo-mechanical characteristics. The results suggest the compounds considered as potential candidates for use in solar cells and/or thermoelectric devices.


title: Uncertainty relations from state polynomial optimization

abstract: Uncertainty relations are a fundamental feature of quantum mechanics. How can these relations be found systematically? Here we make use of the state polynomial optimization framework from Klep et al. [arXiv:2301.12513] to bound the sum of squared expectation values of operators, that are subject to prescribed commutation relations. This yields a complete semidefinite programming hierarchy that converges to tight uncertainty relations. Our hierarchy applies to a wide range of scenarios including tensor-products of Pauli, Heisenberg-Weyl, and fermionic operators, as well as higher order moments.


title: Review on Decarbonizing the Transportation Sector in China: Overview, Analysis, and Perspectives

abstract: This review identifies challenges and effective strategies to decarbonize China's rapidly growing transportation sector, currently the third largest carbon emitter, considering China's commitment to peak carbon emissions by 2030 and achieve carbon neutrality by 2060. Key challenges include rising travel demand, unreached peak car ownership, declining bus ridership, gaps between energy technology research and practical application, and limited institutional capacity for decarbonization. This review categorizes current decarbonization measures, strategies, and policies in China's transportation sector using the "Avoid, Shift, Improve" framework, complemented by a novel strategic vector of "Institutional Capacity & Technology Development" to capture broader development perspectives. This comprehensive analysis aims to facilitate informed decision-making and promote collaborative strategies for China's transition to a sustainable transportation future.


title: PACIA: Parameter-Efficient Adapter for Few-Shot Molecular Property Prediction

abstract: Molecular property prediction (MPP) plays a crucial role in biomedical applications, but it often encounters challenges due to a scarcity of labeled data. Existing works commonly adopt gradient-based strategy to update a large amount of parameters for task-level adaptation. However, the increase of adaptive parameters can lead to overfitting and poor performance. Observing that graph neural network (GNN) performs well as both encoder and predictor, we propose PACIA, a parameter-efficient GNN adapter for few-shot MPP. We design a unified adapter to generate a few adaptive parameters to modulate the message passing process of GNN. We then adopt a hierarchical adaptation mechanism to adapt the encoder at task-level and the predictor at query-level by the unified GNN adapter. Extensive results show that PACIA obtains the state-of-the-art performance in few-shot MPP problems, and our proposed hierarchical adaptation mechanism is rational and effective.


title: Scene-aware Human Motion Forecasting via Mutual Distance Prediction

abstract: In this paper, we tackle the problem of scene-aware 3D human motion forecasting. A key challenge of this task is to predict future human motions that are consistent with the scene by modeling the human-scene interactions. While recent works have demonstrated that explicit constraints on human-scene interactions can prevent the occurrence of ghost motion, they only provide constraints on partial human motion e.g., the global motion of the human or a few joints contacting the scene, leaving the rest of the motion unconstrained. To address this limitation, we propose to model the human-scene interaction with the mutual distance between the human body and the scene. Such mutual distances constrain both the local and global human motion, resulting in a whole-body motion constrained prediction. In particular, mutual distance constraints consist of two components, the signed distance of each vertex on the human mesh to the scene surface and the distance of basis scene points to the human mesh. We further introduce a global scene representation learned from a signed distance function (SDF) volume to ensure coherence between the global scene representation and the explicit constraint from the mutual distance. We develop a pipeline with two sequential steps: predicting the future mutual distances first, followed by forecasting future human motion. During training, we explicitly encourage consistency between predicted poses and mutual distances. Extensive evaluations on the existing synthetic and real datasets demonstrate that our approach consistently outperforms the state-of-the-art methods.


title: Understanding Adversarial Transferability in Federated Learning

abstract: We investigate the robustness and security issues from a novel and practical setting: a group of malicious clients has impacted the model during training by disguising their identities and acting as benign clients, and only revealing their adversary position after the training to conduct transferable adversarial attacks with their data, which is usually a subset of the data that FL system is trained with. Our aim is to offer a full understanding of the challenges the FL system faces in this practical setting across a spectrum of configurations. We notice that such an attack is possible, but the federated model is more robust compared with its centralized counterpart when the accuracy on clean images is comparable. Through our study, we hypothesized the robustness is from two factors: the decentralized training on distributed data and the averaging operation. We provide evidence from both the perspective of empirical experiments and theoretical analysis. Our work has implications for understanding the robustness of federated learning systems and poses a practical question for federated learning applications.


title: Nonparametric priors with full-range borrowing of information

abstract: Modeling of the dependence structure across heterogeneous data is crucial for Bayesian inference since it directly impacts the borrowing of information. Despite the extensive advances over the last two decades, most available proposals allow only for non-negative correlations. We derive a new class of dependent nonparametric priors that can induce correlations of any sign, thus introducing a new and more flexible idea of borrowing of information. This is achieved thanks to a novel concept, which we term hyper-tie, and represents a direct and simple measure of dependence. We investigate prior and posterior distributional properties of the model and develop algorithms to perform posterior inference. Illustrative examples on simulated and real data show that our proposal outperforms alternatives in terms of prediction and clustering.


title: GNRK: Graph Neural Runge-Kutta method for solving partial differential equations

abstract: Neural networks have proven to be efficient surrogate models for tackling partial differential equations (PDEs). However, their applicability is often confined to specific PDEs under certain constraints, in contrast to classical PDE solvers that rely on numerical differentiation. Striking a balance between efficiency and versatility, this study introduces a novel approach called Graph Neural Runge-Kutta (GNRK), which integrates graph neural network modules with a recurrent structure inspired by the classical solvers. The GNRK operates on graph structures, ensuring its resilience to changes in spatial and temporal resolutions during domain discretization. Moreover, it demonstrates the capability to address general PDEs, irrespective of initial conditions or PDE coefficients. To assess its performance, we benchmark the GNRK against existing neural network based PDE solvers using the 2-dimensional Burgers' equation, revealing the GNRK's superiority in terms of model size and accuracy. Additionally, this graph-based methodology offers a straightforward extension for solving coupled differential equations, typically necessitating more intricate models.


title: On Nearly Gorenstein Simplicial Semigroup Algebras

abstract: In this paper, we study the nearly Gorenstein projective closure of numerical semigroups. We also studied the nealy Gorenstein property of associated graded ring of simplicial affine semigroups. Moreover, in case of gluing of numerical semigroups, we answer the question posed by Herzog-Hibi-Stamate.


title: Unraveling active baths through their hidden degrees of freedom

abstract: The dynamics of a probe particle is highly influenced by the nature of the bath in which it is immersed. In particular, baths composed by active (e.g., self-propelled) particles induce intriguing out-of-equilibrium effects on tracer's motion that are customarily described by integrating out the dynamics of the bath's degrees of freedom (DOFs). However, thermodynamic quantities, such as the entropy production rate, are generally severely affected by coarse-graining procedures. Here, we show that active baths are associated with the presence of entropic DOFs exhibiting non-reciprocal interactions with a probe particle. Surprisingly, integrating out these DOFs inevitably results into a system-dependent increase or reduction of the entropy production rate. On the contrary, it stays invariant after integrating out non-entropic DOFs. As a consequence, they determine the dimensionality of isoentropic hypersurfaces in the parameter space. Our results shed light on the nature of active baths, revealing that the presence of a typical correlation time-scale is not a sufficient condition to have non-equilibrium effects on a probe particle, and draws a path towards the understanding of thermodynamically-consistent procedures to derive effective dynamics of observed DOFs.


title: On the convergence sets of operator sequences on spaces of homogeneous type

abstract: We consider sequences of operators $U_n:L^1(X)\to M(X)$, where $X$ is a space of homogeneous type. Under certain conditions on the operators $U_n$ we give a complete characterization of convergence (divergence) sets of functional sequences $U_n(f)$, where $f\in L^p(X)$, $1\le p\le \infty$. The results are applied to characterize convergence sets of some specific operator sequences in classical analysis.


title: Transition path theory for diffusive search with stochastic resetting

abstract: Many chemical reactions can be formulated in terms of particle diffusion in a complex energy landscape. Transition path theory (TPT) is a theoretical framework for describing the direct (reaction) pathways from reactant to product states within this energy landscape, and calculating the effective reaction rate. It is now the standard method for analyzing rare events between long lived states. In this paper, we consider a completely different application of TPT, namely, a dual-aspect diffusive search process in which a particle alternates between collecting cargo from a source domain $A$ and then delivering it to a target domain $B$. The rate of resource accumulation at the target, $k_{AB}$, is determined by the statistics of direct (reactive or transport) paths from A to B. Rather than considering diffusion in a complex energy landscape, we focus on pure diffusion with stochastic resetting. Resetting introduces two non-trivial problems in the application of TPT. First, the process is not time-reversal invariant, which is reflected by the fact that there exists a unique non-equilibrium stationary state (NESS). Second, calculating $k_{AB}$ involves determining the total probability flux of direct transport paths across a dividing surface $S$ between $A$ and $B$. This requires taking into account discontinuous jumps across $S$ due to resetting. We derive a general expression for $k_{AB}$ and show that it is independent of the choice of dividing surface. Finally, using the example of diffusion in a finite interval, we show that there exists an optimal resetting rate at which $k_{AB}$ is maximized. We explore how this feature depends on model parameters.


title: Speed and Density Planning for a Speed-Constrained Robot Swarm Through a Virtual Tube

abstract: The planning and control of a robot swarm in a complex environment have attracted increasing attention. To this end, the idea of virtual tubes has been taken up in our previous work. Specifically, a virtual tube with varying widths has been planned to avoid collisions with obstacles in a complex environment. Based on the planned virtual tube for a large number of speed-constrained robots, the average forward speed and density along the virtual tube are further planned in this paper to ensure safety and improve efficiency. Compared with the existing methods, the proposed method is based on global information and can be applied to traversing narrow spaces for speed-constrained robot swarms. Numerical simulations and experiments are conducted to show that the safety and efficiency of the passing-through process are improved. A video about simulations and experiments is available on https://youtu.be/lJHdMQMqSpc.


title: Transposed Poisson structures on solvable and perfect Lie algebras

abstract: We described all transposed Poisson algebra structures on oscillator Lie algebras, i.e., on one-dimensional solvable extensions of the $(2n+1)$-dimensional Heisenberg algebra; on solvable Lie algebras with naturally graded filiform nilpotent radical; on $(n+1)$-dimensional solvable extensions of the $(2n+1)$-dimensional Heisenberg algebra; and on $n$-dimensional solvable extensions of the $n$-dimensional algebra with the trivial multiplication. We also gave an answer to one question on transposed Poisson algebras early posted in a paper by Beites, Ferreira, and Kaygorodov. Namely, we found a finite-dimensional Lie algebra with non-trivial $\frac{1}{2}$-derivations, but without non-trivial transposed Poisson algebra structures.


title: Reduced basis stabilization and post-processing for the virtual element method

abstract: We present a reduced basis method for cheaply constructing (possibly rough) approximations to the nodal basis functions of the virtual element space, and propose to use such approximations for the design of the stabilization term in the virtual element method and for the post-processing of the solution.


title: GhostEncoder: Stealthy Backdoor Attacks with Dynamic Triggers to Pre-trained Encoders in Self-supervised Learning

abstract: Within the realm of computer vision, self-supervised learning (SSL) pertains to training pre-trained image encoders utilizing a substantial quantity of unlabeled images. Pre-trained image encoders can serve as feature extractors, facilitating the construction of downstream classifiers for various tasks. However, the use of SSL has led to an increase in security research related to various backdoor attacks. Currently, the trigger patterns used in backdoor attacks on SSL are mostly visible or static (sample-agnostic), making backdoors less covert and significantly affecting the attack performance. In this work, we propose GhostEncoder, the first dynamic invisible backdoor attack on SSL. Unlike existing backdoor attacks on SSL, which use visible or static trigger patterns, GhostEncoder utilizes image steganography techniques to encode hidden information into benign images and generate backdoor samples. We then fine-tune the pre-trained image encoder on a manipulation dataset to inject the backdoor, enabling downstream classifiers built upon the backdoored encoder to inherit the backdoor behavior for target downstream tasks. We evaluate GhostEncoder on three downstream tasks and results demonstrate that GhostEncoder provides practical stealthiness on images and deceives the victim model with a high attack success rate without compromising its utility. Furthermore, GhostEncoder withstands state-of-the-art defenses, including STRIP, STRIP-Cl, and SSL-Cleanse.


title: Intelligent Client Selection for Federated Learning using Cellular Automata

abstract: Federated Learning (FL) has emerged as a promising solution for privacy-enhancement and latency minimization in various real-world applications, such as transportation, communications, and healthcare. FL endeavors to bring Machine Learning (ML) down to the edge by harnessing data from million of devices and IoT sensors, thus enabling rapid responses to dynamic environments and yielding highly personalized results. However, the increased amount of sensors across diverse applications poses challenges in terms of communication and resource allocation, hindering the participation of all devices in the federated process and prompting the need for effective FL client selection. To address this issue, we propose Cellular Automaton-based Client Selection (CA-CS), a novel client selection algorithm, which leverages Cellular Automata (CA) as models to effectively capture spatio-temporal changes in a fast-evolving environment. CA-CS considers the computational resources and communication capacity of each participating client, while also accounting for inter-client interactions between neighbors during the client selection process, enabling intelligent client selection for online FL processes on data streams that closely resemble real-world scenarios. In this paper, we present a thorough evaluation of the proposed CA-CS algorithm using MNIST and CIFAR-10 datasets, while making a direct comparison against a uniformly random client selection scheme. Our results demonstrate that CA-CS achieves comparable accuracy to the random selection approach, while effectively avoiding high-latency clients.


title: Low Mach number limit of strong solutions to the compressible primitive equations with gravity

abstract: In this paper, we explore the low Mach number singular limit of the local-in-time strong solutions to the compressible primitive equations with gravity for general adiabatic coefficient. First we construct the uniform estimate for the solutions to the non-dimensional compressible primitive equations with general ill-prepared initial data. Due to the effects of gravity and the anisotropy of the system, the operator with large coefficient in this model is not explicitly skew-symmetric. Thus, obtaining the uniform estimate requires novel techniques. After that, we investigate rigorously the low Mach number limit of the compressible primitive equations with both well-prepared and ill-prepared initial data. The limiting system is shown to be the incompressible primitive equations with inhomogeneous density that depends on the vertical variable.


title: Finger-UNet: A U-Net based Multi-Task Architecture for Deep Fingerprint Enhancement

abstract: For decades, fingerprint recognition has been prevalent for security, forensics, and other biometric applications. However, the availability of good-quality fingerprints is challenging, making recognition difficult. Fingerprint images might be degraded with a poor ridge structure and noisy or less contrasting backgrounds. Hence, fingerprint enhancement plays a vital role in the early stages of the fingerprint recognition/verification pipeline. In this paper, we investigate and improvise the encoder-decoder style architecture and suggest intuitive modifications to U-Net to enhance low-quality fingerprints effectively. We investigate the use of Discrete Wavelet Transform (DWT) for fingerprint enhancement and use a wavelet attention module instead of max pooling which proves advantageous for our task. Moreover, we replace regular convolutions with depthwise separable convolutions, which significantly reduces the memory footprint of the model without degrading the performance. We also demonstrate that incorporating domain knowledge with fingerprint minutiae prediction task can improve fingerprint reconstruction through multi-task learning. Furthermore, we also integrate the orientation estimation task to propagate the knowledge of ridge orientations to enhance the performance further. We present the experimental results and evaluate our model on FVC 2002 and NIST SD302 databases to show the effectiveness of our approach compared to previous works.


title: Sequential Monte Carlo Graph Convolutional Network for Dynamic Brain Connectivity

abstract: An increasingly important brain function analysis modality is functional connectivity analysis which regards connections as statistical codependency between the signals of different brain regions. Graph-based analysis of brain connectivity provides a new way of exploring the association between brain functional deficits and the structural disruption related to brain disorders, but the current implementations have limited capability due to the assumptions of noise-free data and stationary graph topology. We propose a new methodology based on the particle filtering algorithm, with proven success in tracking problems, which estimates the hidden states of a dynamic graph with only partial and noisy observations, without the assumptions of stationarity on connectivity. We enrich the particle filtering state equation with a graph Neural Network called Sequential Monte Carlo Graph Convolutional Network (SMC-GCN), which due to the nonlinear regression capability, can limit spurious connections in the graph. Experiment studies demonstrate that SMC-GCN achieves the superior performance of several methods in brain disorder classification.


title: Jet Lorentz factor constraint for GRB 221009A based on the optical depth of the TeV photons

abstract: The recent detection of tera-electronvolt (TeV) photons from the record-breaking gamma-ray burst GRB 221009A during its prompt phase poses challenges for constraining its Lorentz factor. We re-evaluate the constraints on the jet Lorentz factor considering a two-zone model, wherein the TeV photons originate from the external shock region while the lower energy MeV photons come from the internal prompt emission region. By properly accounting for the evolution of the MeV photon spectrum and light curve, we calculate the optical depth for TeV photons and derive a minimum Lorentz factor about 300. It is consistent with the afterglow modeling for the TeV emission.


title: Win-Win: Training High-Resolution Vision Transformers from Two Windows

abstract: Transformers have become the standard in state-of-the-art vision architectures, achieving impressive performance on both image-level and dense pixelwise tasks. However, training vision transformers for high-resolution pixelwise tasks has a prohibitive cost. Typical solutions boil down to hierarchical architectures, fast and approximate attention, or training on low-resolution crops. This latter solution does not constrain architectural choices, but it leads to a clear performance drop when testing at resolutions significantly higher than that used for training, thus requiring ad-hoc and slow post-processing schemes. In this paper, we propose a novel strategy for efficient training and inference of high-resolution vision transformers. The key principle is to mask out most of the high-resolution inputs during training, keeping only N random windows. This allows the model to learn local interactions between tokens inside each window, and global interactions between tokens from different windows. As a result, the model can directly process the high-resolution input at test time without any special trick. We show that this strategy is effective when using relative positional embedding such as rotary embeddings. It is 4 times faster to train than a full-resolution network, and it is straightforward to use at test time compared to existing approaches. We apply this strategy to three dense prediction tasks with high-resolution data. First, we show on the task of semantic segmentation that a simple setting with 2 windows performs best, hence the name of our method: Win-Win. Second, we confirm this result on the task of monocular depth prediction. Third, we further extend it to the binocular task of optical flow, reaching state-of-the-art performance on the Spring benchmark that contains Full-HD images with an order of magnitude faster inference than the best competitor.


title: A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks

abstract: Benefiting from the rapid development of deep learning, 2D and 3D computer vision applications are deployed in many safe-critical systems, such as autopilot and identity authentication. However, deep learning models are not trustworthy enough because of their limited robustness against adversarial attacks. The physically realizable adversarial attacks further pose fatal threats to the application and human safety. Lots of papers have emerged to investigate the robustness and safety of deep learning models against adversarial attacks. To lead to trustworthy AI, we first construct a general threat model from different perspectives and then comprehensively review the latest progress of both 2D and 3D adversarial attacks. We extend the concept of adversarial examples beyond imperceptive perturbations and collate over 170 papers to give an overview of deep learning model robustness against various adversarial attacks. To the best of our knowledge, we are the first to systematically investigate adversarial attacks for 3D models, a flourishing field applied to many real-world applications. In addition, we examine physical adversarial attacks that lead to safety violations. Last but not least, we summarize present popular topics, give insights on challenges, and shed light on future research on trustworthy AI.


title: On Cubical Sets of Quivers and Digraphs

abstract: The singular cubical homology theory for the category of quivers or digraphs can be constructed similarly to the classical singular homology theory for topological spaces. The case of digraphs and quivers differs from the topological case due to the possibility of using a large number of non-isomorphic line digraphs that correspond to the unit interval in algebraic topology. In this paper we introduce several different notions of quiver realizations of a cubical set and we describe relations between them. We also define various singular cubical homology theories on quivers and digraphs. Moreover, using quiver realizations of cubical sets we define a collection of path homology theories on the category of cubical sets and we describe their properties.


title: Reinforcement Learning Based Neighbour Selection for VANET with Adaptive Trust Management

abstract: Successful information propagation from source to destination in Vehicular Adhoc Network (VANET) can be hampered by the presence of neighbouring attacker nodes causing unwanted packet dropping. Potential attackers change their behaviour over time and remain undetected due to the ad-hoc nature of VANET. Capturing the dynamic attacker behaviour and updating the corresponding neighbourhood information without compromising the quality of service requirements is an ongoing challenge. This work proposes a Reinforcement Learning (RL) based neighbour selection framework for VANET with an adaptive trust management system to capture the behavioural changes of potential attackers and to dynamically update the neighbourhood information. In contrast to existing works, we consider trust and link-life time in unison as neighbour selection criteria to achieve trustworthy communication. Our adaptive trust model takes into account the social relationship, time and confidence in trust observation to avoid four types of attackers. To update the neighbourhood information, our framework sets the learning rate of the RL agent according to the velocities of the neighbour nodes to improve the model's adaptability to network topology changes. Results demonstrate that our method can take less number of hops to the destination for large network sizes while can response is up to 54 percent faster compared to a baseline method. Also, the proposed model can outperform the other baseline method by reducing the packet dropping rate up to 57 percent caused by the attacker.


title: A DEIM-CUR factorization with iterative SVDs

abstract: A CUR factorization is often utilized as a substitute for the singular value decomposition (SVD), especially when a concrete interpretation of the singular vectors is challenging. Moreover, if the original data matrix possesses properties like nonnegativity and sparsity, a CUR decomposition can better preserve them compared to the SVD. An essential aspect of this approach is the methodology used for selecting a subset of columns and rows from the original matrix. This study investigates the effectiveness of \emph{one-round sampling} and iterative subselection techniques and introduces new iterative subselection strategies based on iterative SVDs. One provably appropriate technique for index selection in constructing a CUR factorization is the discrete empirical interpolation method (DEIM). Our contribution aims to improve the approximation quality of the DEIM scheme by iteratively invoking it in several rounds, in the sense that we select subsequent columns and rows based on the previously selected ones. Thus, we modify $A$ after each iteration by removing the information that has been captured by the previously selected columns and rows. We also discuss how iterative procedures for computing a few singular vectors of large data matrices can be integrated with the new iterative subselection strategies. We present the results of numerical experiments, providing a comparison of one-round sampling and iterative subselection techniques, and demonstrating the improved approximation quality associated with using the latter.


title: Knowledge Engineering using Large Language Models

abstract: Knowledge engineering is a discipline that focuses on the creation and maintenance of processes that generate and apply knowledge. Traditionally, knowledge engineering approaches have focused on knowledge expressed in formal languages. The emergence of large language models and their capabilities to effectively work with natural language, in its broadest sense, raises questions about the foundations and practice of knowledge engineering. Here, we outline the potential role of LLMs in knowledge engineering, identifying two central directions: 1) creating hybrid neuro-symbolic knowledge systems; and 2) enabling knowledge engineering in natural language. Additionally, we formulate key open research questions to tackle these directions.


title: A primal-dual perspective for distributed TD-learning

abstract: The goal of this paper is to investigate distributed temporal difference (TD) learning for a networked multi-agent Markov decision process. The proposed approach is based on distributed optimization algorithms, which can be interpreted as primal-dual Ordinary differential equation (ODE) dynamics subject to null-space constraints. Based on the exponential convergence behavior of the primal-dual ODE dynamics subject to null-space constraints, we examine the behavior of the final iterate in various distributed TD-learning scenarios, considering both constant and diminishing step-sizes and incorporating both i.i.d. and Markovian observation models. Unlike existing methods, the proposed algorithm does not require the assumption that the underlying communication network structure is characterized by a doubly stochastic matrix.


title: Segmentation-based Assessment of Tumor-Vessel Involvement for Surgical Resectability Prediction of Pancreatic Ductal Adenocarcinoma

abstract: Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive cancer with limited treatment options. This research proposes a workflow and deep learning-based segmentation models to automatically assess tumor-vessel involvement, a key factor in determining tumor resectability. Correct assessment of resectability is vital to determine treatment options. The proposed workflow involves processing CT scans to segment the tumor and vascular structures, analyzing spatial relationships and the extent of vascular involvement, which follows a similar way of working as expert radiologists in PDAC assessment. Three segmentation architectures (nnU-Net, 3D U-Net, and Probabilistic 3D U-Net) achieve a high accuracy in segmenting veins, arteries, and the tumor. The segmentations enable automated detection of tumor involvement with high accuracy (0.88 sensitivity and 0.86 specificity) and automated computation of the degree of tumor-vessel contact. Additionally, due to significant inter-observer variability in these important structures, we present the uncertainty captured by each of the models to further increase insights into the predicted involvement. This result provides clinicians with a clear indication of tumor-vessel involvement and may be used to facilitate more informed decision-making for surgical interventions. The proposed method offers a valuable tool for improving patient outcomes, personalized treatment strategies and survival rates in pancreatic cancer.


title: On the geometry at infinity of manifolds with linear volume growth and nonnegative Ricci curvature

abstract: We prove that an open manifold with nonnegative Ricci curvature, linear volume growth and noncollapsed ends always splits off a line at infinity. This completes the final step to prove the existence of isoperimetric sets given large volumes in the above setting. We also find that under our assumptions, the diameter of the level sets of any Busemann function are uniformly bounded as opposed to a classical result stating that they can have sublinear growth when ends are collapsing. Moreover, some equivalent characterizations of linear volume growth are given. Finally, we construct an example to show that for manifolds in our setting, although their limit spaces at infinity are always cylinders, the cross sections can be nonhomeomorphic.


title: RegBN: Batch Normalization of Multimodal Data with Regularization

abstract: Recent years have witnessed a surge of interest in integrating high-dimensional data captured by multisource sensors, driven by the impressive success of neural networks in the integration of multimodal data. However, the integration of heterogeneous multimodal data poses a significant challenge, as confounding effects and dependencies among such heterogeneous data sources introduce unwanted variability and bias, leading to suboptimal performance of multimodal models. Therefore, it becomes crucial to normalize the low- or high-level features extracted from data modalities before their fusion takes place. This paper introduces a novel approach for the normalization of multimodal data, called RegBN, that incorporates regularization. RegBN uses the Frobenius norm as a regularizer term to address the side effects of confounders and underlying dependencies among different data sources. The proposed method generalizes well across multiple modalities and eliminates the need for learnable parameters, simplifying training and inference. We validate the effectiveness of RegBN on eight databases from five research areas, encompassing diverse modalities such as language, audio, image, video, depth, tabular, and 3D MRI. The proposed method demonstrates broad applicability across different architectures such as multilayer perceptrons, convolutional neural networks, and vision transformers, enabling effective normalization of both low- and high-level features in multimodal neural networks. RegBN is available at \url{https://github.com/mogvision/regbn}.


title: From Bandits Model to Deep Deterministic Policy Gradient, Reinforcement Learning with Contextual Information

abstract: The problem of how to take the right actions to make profits in sequential process continues to be difficult due to the quick dynamics and a significant amount of uncertainty in many application scenarios. In such complicated environments, reinforcement learning (RL), a reward-oriented strategy for optimum control, has emerged as a potential technique to address this strategic decision-making issue. However, reinforcement learning also has some shortcomings that make it unsuitable for solving many financial problems, excessive resource consumption, and inability to quickly obtain optimal solutions, making it unsuitable for quantitative trading markets. In this study, we use two methods to overcome the issue with contextual information: contextual Thompson sampling and reinforcement learning under supervision which can accelerate the iterations in search of the best answer. In order to investigate strategic trading in quantitative markets, we merged the earlier financial trading strategy known as constant proportion portfolio insurance (CPPI) into deep deterministic policy gradient (DDPG). The experimental results show that both methods can accelerate the progress of reinforcement learning to obtain the optimal solution.


title: Polarization-sensitive photoluminescence from aligned carbon chains terminated by gold clusters

abstract: We synthesize a thin film composed of long carbyne chains terminated by gold clusters and study its optical properties. The presence of gold particles stabilizes longer chains and leads to their alignment. We show that the gold clusters also act as a source of electron doping thus changing the intensity of photoluminescence from quadratic dependence on the pumping intensity without gold to linear with gold. We also observe that the excitation of the film at the gold plasmon frequency causes the blue shift of photoluminescence and estimate on the basis of this effect the minimum length of the carbyne chains. The high degree of alignment of the gold-terminated carbyne chains results in strongly anisotropic light absorption characterized by a distinctive cosine dependence on the angle between the carbyne molecule and polarization plane of the excitation. This paves the way for a new class of ultimately-thin polarization sensitive emitters to be used in future integrated quantum photonics devices.


title: On the Hardness of $\sf{S|LWE\rangle}$ with Gaussian and Other Amplitudes

abstract: The learning with errors problem (LWE) is one of the most important building blocks for post-quantum cryptography. To better understand the quantum hardness of LWE, it is crucial to explore quantum variants of LWE, show quantum algorithms for those variants, or prove they are as hard as standard LWE. To this end, Chen, Liu, and Zhandry [Eurocrypt 2022] define the $\sf{S|LWE\rangle}$ problem, which encodes the error of LWE samples into quantum amplitudes. They then show efficient quantum algorithms for $\sf{S|LWE\rangle}$ with a few interesting amplitudes. However, the hardness of the most interesting amplitude, Gaussian, was not addressed by Chen et al., or only known for some restricted settings (for example, when the number of $\sf{S|LWE\rangle}$ samples is very small, it is well known that $\sf{S|LWE\rangle}$ is as hard as standard LWE). In this paper, we show new hardness and algorithms for $\sf{S|LWE\rangle}$ with Gaussian and other amplitudes. Our main results are 1. There exist quantum reductions from standard LWE or worst-case GapSVP to $\sf{S|LWE\rangle}$ with Gaussian amplitude with unknown phase, and arbitrarily many $\sf{S|LWE\rangle}$ samples. 2. There is a $2^{\widetilde{O}(\sqrt{n})}$-time algorithm for $\sf{S|LWE\rangle}$ with Gaussian amplitude with known phase, given $2^{\widetilde{O}(\sqrt{n})}$ many quantum samples. The algorithm is modified from Kuperberg's sieve, and in fact works for more general amplitudes as long as the amplitudes and phases are completely known. One way of interpreting our result is: to show a sub-exponential time quantum algorithm for standard LWE, all we need is to handle phases in $\sf{S|LWE\rangle}$ amplitudes better, either in the algorithm or the reduction.


title: An alternative proof of the $L^p$-regularity problem for Dahlberg-Kenig-Pipher operators on $\mathbb R^n_+$

abstract: In this article, we give an alternative and simpler proof of the solvability of the regularity problem - i.e. the Dirichlet problem with boundary data in $W^{1,p}$ - for uniformly elliptic operators on $\mathbb R^n_+$ satisfying a (possibly large) Carleson condition. We also slightly enlarge the class of operators for which the regularity problem is solvable and gives the analogue result for weighted uniformly elliptic operators on $\mathbb R^n \setminus \mathbb R^d$, $d<n-1$.


title: WASA: WAtermark-based Source Attribution for Large Language Model-Generated Data

abstract: The impressive performances of large language models (LLMs) and their immense potential for commercialization have given rise to serious concerns over the intellectual property (IP) of their training data. In particular, the synthetic texts generated by LLMs may infringe the IP of the data being used to train the LLMs. To this end, it is imperative to be able to (a) identify the data provider who contributed to the generation of a synthetic text by an LLM (source attribution) and (b) verify whether the text data from a data provider has been used to train an LLM (data provenance). In this paper, we show that both problems can be solved by watermarking, i.e., by enabling an LLM to generate synthetic texts with embedded watermarks that contain information about their source(s). We identify the key properties of such watermarking frameworks (e.g., source attribution accuracy, robustness against adversaries), and propose a WAtermarking for Source Attribution (WASA) framework that satisfies these key properties due to our algorithmic designs. Our WASA framework enables an LLM to learn an accurate mapping from the texts of different data providers to their corresponding unique watermarks, which sets the foundation for effective source attribution (and hence data provenance). Extensive empirical evaluations show that our WASA framework achieves effective source attribution and data provenance.


title: Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context Learning

abstract: Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with recent LMMs reveals major limitations that are hardly captured by the current evaluation benchmarks. Indeed, task performances (e.g., VQA accuracy) alone do not provide enough clues to understand their real capabilities, limitations, and to which extent such models are aligned to human expectations. To refine our understanding of those flaws, we deviate from the current evaluation paradigm, and (1) evaluate 10 recent open-source LMMs from 3B up to 80B parameter scale, on 5 different axes; hallucinations, abstention, compositionality, explainability and instruction following. Our evaluation on these axes reveals major flaws in LMMs. While the current go-to solution to align these models is based on training, such as instruction tuning or RLHF, we rather (2) explore the training-free in-context learning (ICL) as a solution, and study how it affects these limitations. Based on our ICL study, (3) we push ICL further and propose new multimodal ICL variants such as; Multitask-ICL, Chain-of-Hindsight-ICL, and Self-Correcting-ICL. Our findings are as follows. (1) Despite their success, LMMs have flaws that remain unsolved with scaling alone. (2) The effect of ICL on LMMs flaws is nuanced; despite its effectiveness for improved explainability, answer abstention, ICL only slightly improves instruction following, does not improve compositional abilities, and actually even amplifies hallucinations. (3) The proposed ICL variants are promising as post-hoc approaches to efficiently tackle some of those flaws. The code is available here: https://github.com/mshukor/EvALign-ICL.


title: PETA: Parameter-Efficient Trojan Attacks

abstract: Parameter-efficient fine-tuning (PEFT) enables efficient adaptation of pre-trained language models (PLMs) to specific tasks. By tuning only a minimal set of (extra) parameters, PEFT achieves performance that is comparable to standard fine-tuning. However, despite its prevalent use, the security implications of PEFT remain largely unexplored. In this paper, we take the initial steps and present PETA, a novel trojan attack that compromises the weights of PLMs by accounting for downstream adaptation through bilevel optimization: the upper-level objective embeds the backdoor into a model while the lower-level objective simulates PEFT to both retain the PLM's task-specific performance and ensure that the backdoor persists after fine-tuning. With extensive evaluation across a variety of downstream tasks and trigger designs, we demonstrate PETA's effectiveness in terms of both attack success rate and clean accuracy, even when the attacker does not have full knowledge of the victim user's training process.