title: Language Models are Universal Embedders

abstract: In the large language model (LLM) revolution, embedding is a key component of various systems. For example, it is used to retrieve knowledge or memories for LLMs, to build content moderation filters, etc. As such cases span from English to other natural or programming languages, from retrieval to classification and beyond, it is desirable to build a unified embedding model rather than dedicated ones for each scenario. In this work, we make an initial step towards this goal, demonstrating that multiple languages (both natural and programming) pre-trained transformer decoders can embed universally when finetuned on limited English data. We provide a comprehensive practice with thorough evaluations. On English MTEB, our models achieve competitive performance on different embedding tasks by minimal training data. On other benchmarks, such as multilingual classification and code search, our models (without any supervision) perform comparably to, or even surpass heavily supervised baselines and/or APIs. These results provide evidence of a promising path towards building powerful unified embedders that can be applied across tasks and languages.


title: The Impact of Time Step Frequency on the Realism of Robotic Manipulation Simulation for Objects of Different Scales

abstract: This work evaluates the impact of time step frequency and component scale on robotic manipulation simulation accuracy. Increasing the time step frequency for small-scale objects is shown to improve simulation accuracy. This simulation, demonstrating pre-assembly part picking for two object geometries, serves as a starting point for discussing how to improve Sim2Real transfer in robotic assembly processes.


title: CiRA: An Open-Source Python Package for Automated Generation of Test Case Descriptions from Natural Language Requirements

abstract: Deriving acceptance tests from high-level, natural language requirements that achieve full coverage is a major manual challenge at the interface between requirements engineering and testing. Conditional requirements (e.g., "If A or B then C.") imply causal relationships which - when extracted - allow to generate these acceptance tests automatically. This paper presents a tool from the CiRA (Causality In Requirements Artifacts) initiative, which automatically processes conditional natural language requirements and generates a minimal set of test case descriptions achieving full coverage. We evaluate the tool on a publicly available data set of 61 requirements from the requirements specification of the German Corona-Warn-App. The tool infers the correct test variables in 84.5% and correct variable configurations in 92.3% of all cases, which corroborates the feasibility of our approach.


title: GROOT: Learning to Follow Instructions by Watching Gameplay Videos

abstract: We study the problem of building a controller that can follow open-ended instructions in open-world environments. We propose to follow reference videos as instructions, which offer expressive goal specifications while eliminating the need for expensive text-gameplay annotations. A new learning framework is derived to allow learning such instruction-following controllers from gameplay videos while producing a video instruction encoder that induces a structured goal space. We implement our agent GROOT in a simple yet effective encoder-decoder architecture based on causal transformers. We evaluate GROOT against open-world counterparts and human players on a proposed Minecraft SkillForge benchmark. The Elo ratings clearly show that GROOT is closing the human-machine gap as well as exhibiting a 70% winning rate over the best generalist agent baseline. Qualitative analysis of the induced goal space further demonstrates some interesting emergent properties, including the goal composition and complex gameplay behavior synthesis. The project page is available at https://craftjarvis-groot.github.io.


title: On A Generalization of Motohashi's Formula

abstract: We give an adelic version of a spectral reciprocity formula relating $\mathrm{GL}_3 \times \mathrm{GL}_2$ with $\mathrm{GL}_3 \times \mathrm{GL}_1$ and $\mathrm{GL}_1$ moments of $L$-functions discovered by Xiaoqing Li. For many types of the $\mathrm{GL}_3$ representation, we describe the local weight transforms via a decomposition of Voronoi's formula in terms of elementary transforms, which generalizes the one given by Miller--Schmid in a way consistent with the local Langlands correspondence. We obtain some integral representation of the Bessel functions for $\mathrm{GL}_2$ uniformly over all local fields. We announce the dual weight computation in a new case, which identifies the coset problem parallel to that in Petrow--Young's Weyl-type subconvexity for general Dirichlet $L$-functions. The proof and extensive study of other accessible cases will be given in a separate paper.


title: Towards a Unified Analysis of Kernel-based Methods Under Covariate Shift

abstract: Covariate shift occurs prevalently in practice, where the input distributions of the source and target data are substantially different. Despite its practical importance in various learning problems, most of the existing methods only focus on some specific learning tasks and are not well validated theoretically and numerically. To tackle this problem, we propose a unified analysis of general nonparametric methods in a reproducing kernel Hilbert space (RKHS) under covariate shift. Our theoretical results are established for a general loss belonging to a rich loss function family, which includes many commonly used methods as special cases, such as mean regression, quantile regression, likelihood-based classification, and margin-based classification. Two types of covariate shift problems are the focus of this paper and the sharp convergence rates are established for a general loss function to provide a unified theoretical analysis, which concurs with the optimal results in literature where the squared loss is used. Extensive numerical studies on synthetic and real examples confirm our theoretical findings and further illustrate the effectiveness of our proposed method.


title: Locality Error Free Effective Core Potentials for 3d Transition Metal Elements Developed for the Diffusion Monte Carlo Method

abstract: Pseudopotential locality errors have hampered the applications of the diffusion Monte Carlo (DMC) method in materials containing transition metals, in particular oxides. We have developed locality error free effective core potentials, pseudo-Hamiltonians, for transition metals ranging from Cr to Zn. We have modified a procedure published by some of us in [M.C. Bennett et al, JCTC 18 (2022)]. We carefully optimized our pseudo-Hamiltonians and achieved transferability errors comparable to the best semilocal pseudopotentials used with DMC but without incurring in locality errors. Our pseudo-Hamiltonian set (named OPH23) bears the potential to significantly improve the accuracy of many-body-first-principles calculations in fundamental science research of complex materials involving transition metals.


title: Centrosymmetric and reverse matrices in bivariate orthogonal polynomials

abstract: We introduce the concept of reflexive moment functional in two variables and the definition of reflexive orthogonal polynomial system. Also reverse matrices and their interesting algebraic properties are studied. Reverse matrices and reflexive polynomial systems are directly connected in the context of bivariate orthogonal polynomials. Centrosymmetric matrices, reverse matrices and their connections with reflexive orthogonal polynomial systems are presented. Finally, several particular cases and examples are analysed.


title: Who Said That? Benchmarking Social Media AI Detection

abstract: AI-generated text has proliferated across various online platforms, offering both transformative prospects and posing significant risks related to misinformation and manipulation. Addressing these challenges, this paper introduces SAID (Social media AI Detection), a novel benchmark developed to assess AI-text detection models' capabilities in real social media platforms. It incorporates real AI-generate text from popular social media platforms like Zhihu and Quora. Unlike existing benchmarks, SAID deals with content that reflects the sophisticated strategies employed by real AI users on the Internet which may evade detection or gain visibility, providing a more realistic and challenging evaluation landscape. A notable finding of our study, based on the Zhihu dataset, reveals that annotators can distinguish between AI-generated and human-generated texts with an average accuracy rate of 96.5%. This finding necessitates a re-evaluation of human capability in recognizing AI-generated text in today's widely AI-influenced environment. Furthermore, we present a new user-oriented AI-text detection challenge focusing on the practicality and effectiveness of identifying AI-generated text based on user information and multiple responses. The experimental results demonstrate that conducting detection tasks on actual social media platforms proves to be more challenging compared to traditional simulated AI-text detection, resulting in a decreased accuracy. On the other hand, user-oriented AI-generated text detection significantly improve the accuracy of detection.


title: Generalized Riemann Problem Method for the Kapila Model of Compressible Multiphase Flows I: Temporal-Spatial Coupling Finite Volume Scheme

abstract: A second-order accurate and robust numerical scheme is developed for the Kapila model to simulate compressible multiphase flows. The scheme is formulated within the temporal-spatial coupling framework with the generalized Riemann problem (GRP) solver applied as the cornerstone. The use of the GRP solver enhances the capability of the resulting scheme to handle the stiffness of the Kapila model in two ways. Firstly, in addition to Riemann solutions, the time derivatives of flow variables at cell interfaces are obtained by the GRP solver. The coupled values, i.e. Riemann solutions and time derivatives, lead to a straightforward approximation to the velocity divergence at the next time level, enabling a semi-implicit time discretization to the volume fraction equation. Secondly, the use of time derivatives enables numerical fluxes to comprehensively account for the effect of the source term, which includes interactions between phases. The robustness of the resulting numerical scheme is therefore further improved. Several challenging numerical experiments are conducted to demonstrate the performance of the proposed finite volume scheme. In particular, a test case with a nonlinear smooth solution is designed to verify the numerical accuracy.


title: Beyond the Pandemic: Transforming Software Development with the IJARS Model for Wellbeing and Resilience

abstract: This article delves into the lessons learned, highlighting the importance of developer wellbeing. We introduce the Integrated Job Demands-Resources and Self-Determination Model (IJARS) for a comprehensive understanding of pandemic-era productivity. Emphasizing Agile values, mental health initiatives, and learning from disruptions, we advocate for reshaped workplaces that prioritize work-life balance and hybrid models, preparing for future challenges. This guidance aims for a resilient and adaptive future, turning adversity into opportunity.


title: Computing Twin-Width Parameterized by the Feedback Edge Number

abstract: The problem of whether and how one can compute the twin-width of a graph -- along with an accompanying contraction sequence -- lies at the forefront of the area of algorithmic model theory. While significant effort has been aimed at obtaining a fixed-parameter approximation for the problem when parameterized by twin-width, here we approach the question from a different perspective and consider whether one can obtain (near-)optimal contraction sequences under a larger parameterization, notably the feedback edge number $k$. As our main contributions, under this parameterization we obtain (1) a linear bikernel for the problem of either computing a $2$-contraction sequence or determining that none exists and (2) an approximate fixed-parameter algorithm which computes an $\ell$-contraction sequence (for an arbitrary specified $\ell$) or determines that the twin-width of the input graph is at least $\ell$. These algorithmic results rely on newly obtained insights into the structure of optimal contraction sequences, and as a byproduct of these we also slightly tighten the bound on the twin-width of graphs with small feedback edge number.


title: Effect of the brightest gamma-ray burst (GRB 221009A) on low energy gamma-ray counts at sea level

abstract: A gamma-ray burst, named GRB 221009A, occurred on 9 October 2022 and is the brightest ever observed GRB, whose frequency is now estimated as once in 10,000 years. This GRB was reported to be observed from many space missions, VLF receivers, and ground observations in optical and radio data. Additionally, a strikingly large number of very high energy (VHE) photons associated with this GRB were observed by the gamma-ray and cosmic ray observatory LHAASO. Though gamma rays of cosmic origin usually tend to be absorbed by the atmosphere, the high fluence of this GRB, along with the observation of more than 5000 VHE photons (0.5 to 18 TeV) by LHAASO from the ground, emphasises the need to explore other possible ground observations of this GRB. The present paper examines the effect of this GRB using gamma-ray data in a low energy range (0.2-6) MeV obtained using NaI (Tl) detectors located at Tirunelveli (Geographic coordinates: 8.71{\deg}N, 77.76{\deg}E), India. With RA = 288.3{\deg} and Dec = 19.8{\deg}, the exceptionally bright fluence of this GRB was geographically centred on India. We report no significant change in the observations associated with GRB 221009A. We discuss the extent of attenuation of gamma-rays in the atmosphere that could explain the reported observations. Further, we investigate the likelihood of ground observation of gamma-rays ($<$10 MeV) for a much more intense hypothetical GRB, and estimate the parameters, such as distance, fluence, and isotropic energy of such a GRB.


title: A sharp geometric inequality for closed hypersurfaces in manifolds with asymptotically nonnegative curvature

abstract: In this work we establish a sharp geometric inequality for closed hypersurfaces in complete noncompact Riemannian manifolds with asymptotically nonnegative curvature using standard comparison methods in Riemannian Geometry. These methods have been applied in a recent work by Xiaodong Wang to greatly simplify the proof of a Willmore-type inequality in complete noncompact Riemannian manifolds of nonnegative Ricci curvature, which was first proved by Agostiniani, Fagagnolo and Mazzieri.


title: Collaborative Precoding Design for Adjacent Integrated Sensing and Communication Base Stations

abstract: Integrated sensing and communication (ISAC) base stations can provide communication and wide range sensing information for vehicles via downlink (DL) transmission, thus enhancing vehicle driving safety. One major challenge for realizing high performance communication and sensing is how to deal with the DL mutual interference among adjacent ISAC base stations, which includes not only communication related interference, but also radar sensing related interference. In this paper, we establish a DL mutual interference model of adjacent ISAC base stations, and analyze the relationship for mutual interference channels between communications and radar sensing. To improve the sensing and communication performance, we propose a collaborative precoding design for coordinated adjacent base stations to mitigate the mutual interference under the transmit power constraint and constant modulus constraint, which is formulated as a non-convex optimization problem. We first relax the problem into a convex programming by omitting the rank constraint, and propose a joint optimization algorithm to solve the problem. We furthermore propose a sequential optimization algorithm, which divides the collaborative precoding design problem into four subproblems and finds the optimum via a gradient descent algorithm. Finally, we evaluate the collaborative precoding design algorithms by considering sensing and communication performance via numerical results.


title: Leveraging DevOps for Scientific Computing

abstract: Critical goals of scientific computing are to increase scientific rigor, reproducibility, and transparency while keeping up with ever-increasing computational demands. This work presents an integrated framework well-suited for data processing and analysis spanning individual, on-premises, and cloud environments. This framework leverages three well-established DevOps tools: 1) Git repositories linked to 2) CI/CD engines operating on 3) containers. It supports the full life-cycle of scientific data workflows with minimal friction between stages--including solutions for researchers who generate data. This is achieved by leveraging a single container that supports local, interactive user sessions and deployment in HPC or Kubernetes clusters. Combined with Git repositories integrated with CI/CD, this approach enables decentralized data pipelines across multiple, arbitrary computational environments. This framework has been successfully deployed and validated within our research group, spanning experimental acquisition systems and computational clusters with open-source, purpose-built GitLab CI/CD executors for slurm and Google Kubernetes Engine Autopilot. Taken together, this framework can increase the rigor, reproducibility, and transparency of compute-dependent scientific research.


title: Visualizing a Nondeterministic to Deterministic Finite-State Machine Transformation

abstract: The transformation of a nondeterministic finite-state automaton into a deterministic finite-state automaton is an integral part of any course on formal languages and automata theory. For some students, understanding this transformation is challenging. Common problems encountered include not comprehending how the states of the deterministic finite-state automaton are determined and not comprehending the role that all the edges of the nondeterministic finite-state automaton have in the deterministic finite-state automaton's construction. To aid students in understanding, transformation visualization tools have been developed. Although useful in helping students, these tools do not properly illustrate the relationship between the states of the deterministic finite-state automaton and the edges of the nondeterministic finite-state automaton. This article presents a novel interactive visualization tool to illustrate the transformation that highlights this relationship and that is integrated into the FSM programming language. In addition, the implementation of the visualization is sketched.


title: Mgii h&k fine structure prominence modelling and the consequences for observations

abstract: Aims: Using 2D Mgii h&k solar prominence modelling, our aim is to understand the formation of complex line profiles and how these are seen by the Interface Region Imaging Spectrograph (IRIS). Additionally, we see how the properties of these simulated observations are interpreted through the use of traditional 1D prominence modelling. Methods: We used a cylindrical non-local thermodynamic equilibrium (NLTE) 2D complete redistribution (CRD) code to generate a set of cylindrical prominence strands, which we stacked behind each other to produce complex line profiles. Then, with the use of the point spread functions (PSFs) of IRIS, we were able to predict how IRIS would observe these line profiles. We then used the 1D NLTE code PROM in combination with the Cross Root Mean Square method (xRMS) to find the properties recovered by traditional 1D prominence modelling. Results: Velocities of magnitude lower than 10 km/s are sufficient to produce asymmetries in the Mgii h&k lines. However, convolution of these with the PSFs of IRIS obscures this detail and returns standard looking single peaks. By increasing the velocities by a factor of three, we recover asymmetric profiles even after this convolution. The properties recovered by xRMS appear adequate at first, but the line profiles chosen to fit these profiles do not satisfactorily represent the line profiles. This is likely due to the large line width of the simulated profiles. Conclusions: Asymmetries can be introduced by multithread models with independent Doppler velocities. The large line width created by these models makes it difficult for traditional 1D forward modelling to find good matches. This may also demonstrate degeneracies in the solution recovered by single-species 1D modelling.


title: Attosecond Ionization Time Delays in Strong-Field Physics

abstract: Electronic processes within atoms and molecules reside on the timescale of attoseconds. Recent advances in the laser-based pump-probe interrogation techniques have made possible the temporal resolution of ultrafast electronic processes on the attosecond timescale, including photoionization and tunneling ionization. These interrogation techniques include the attosecond streak camera, the reconstruction of attosecond beating by interference of two-photon transitions, and the attoclock. While the former two are usually employed to study photoionization processes, the latter is typically used to investigate tunneling ionization. In this Topical Review, we briefly overview these timing techniques towards an attosecond temporal resolution of ionization processes in atoms and molecules under intense laser fields. In particular, we review the backpropagation method, which is a novel hybrid quantum-classical approach towards full characterization of tunneling ionization dynamics. Continued advances in the interrogation techniques promise to pave the pathway towards the exploration of ever faster dynamical processes on an ever shorter timescale.


title: Underwater Sound Speed Profile Construction: A Review

abstract: Real--time and accurate construction of regional sound speed profiles (SSP) is important for building underwater positioning, navigation, and timing (PNT) systems as it greatly affect the signal propagation modes such as trajectory. In this paper, we summarizes and analyzes the current research status in the field of underwater SSP construction, and the mainstream methods include direct SSP measurement and SSP inversion. In the direct measurement method, we compare the performance of popular international commercial temperature, conductivity, and depth profilers (CTD). While for the inversion methods, the framework and basic principles of matched field processing (MFP), compressive sensing (CS), and deep learning (DL) for constructing SSP are introduced, and their advantages and disadvantages are compared. The traditional direct measurement method has good accuracy performance, but it usually takes a long time. The proposal of SSP inversion method greatly improves the convenience and real--time performance, but the accuracy is not as good as the direct measurement method. Currently, the SSP inversion relies on sonar observation data, making it difficult to apply to areas that couldn't be covered by underwater observation systems, and these methods are unable to predict the distribution of sound velocity at future times. How to comprehensively utilize multi-source data and provide elastic sound velocity distribution estimation services with different accuracy and real-time requirements for underwater users without sonar observation data is the mainstream trend in future research on SSP construction.


title: MetaBox: A Benchmark Platform for Meta-Black-Box Optimization with Reinforcement Learning

abstract: Recently, Meta-Black-Box Optimization with Reinforcement Learning (MetaBBO-RL) has showcased the power of leveraging RL at the meta-level to mitigate manual fine-tuning of low-level black-box optimizers. However, this field is hindered by the lack of a unified benchmark. To fill this gap, we introduce MetaBox, the first benchmark platform expressly tailored for developing and evaluating MetaBBO-RL methods. MetaBox offers a flexible algorithmic template that allows users to effortlessly implement their unique designs within the platform. Moreover, it provides a broad spectrum of over 300 problem instances, collected from synthetic to realistic scenarios, and an extensive library of 19 baseline methods, including both traditional black-box optimizers and recent MetaBBO-RL methods. Besides, MetaBox introduces three standardized performance metrics, enabling a more thorough assessment of the methods. In a bid to illustrate the utility of MetaBox for facilitating rigorous evaluation and in-depth analysis, we carry out a wide-ranging benchmarking study on existing MetaBBO-RL methods. Our MetaBox is open-source and accessible at: https://github.com/GMC-DRL/MetaBox.


title: EVStabilityNet: Predicting the Stability of Star Clusters in General Relativity

abstract: We present a deep neural network which predicts the stability of isotropic steady states of the asymptotically flat, spherically symmetric Einstein-Vlasov system in Schwarzschild coordinates. The network takes as input the energy profile and the redshift of the steady state. Its architecture consists of a U-Net with a dense bridge. The network was trained on more than ten thousand steady states using an active learning scheme and has high accuracy on test data. As first applications, we analyze the validity of physical hypotheses regarding the stability of the steady states.


title: Genesis of column sprites: Formation mechanisms and optical structures

abstract: Sprite discharges are electrical discharges that initiate from the lower ionosphere during intense lightning storms, manifesting themselves optically as flashes of light that last a few milliseconds. This study unravels sprite initiation mechanisms and evolution into distinctive morphologies like glows and beads, using direct 3D numerical simulations that capture the intricate electrical discharge processes. We clarify various morphological aspects of sprites such as the halo dynamics, column glows, branching, streamer reconnection, and bead formation. The results advance our understanding of sprites and their connection to thunderstorm dynamics, and puts quantitative analysis of their effect on Earth's climate within reach.


title: Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification

abstract: Vision-Language Models (VLMs) such as CLIP are trained on large amounts of image-text pairs, resulting in remarkable generalization across several data distributions. However, in several cases, their expensive training and data collection/curation costs do not justify the end application. This motivates a vendor-client paradigm, where a vendor trains a large-scale VLM and grants only input-output access to clients on a pay-per-query basis in a black-box setting. The client aims to minimize inference cost by distilling the VLM to a student model using the limited available task-specific data, and further deploying this student model in the downstream application. While naive distillation largely improves the In-Domain (ID) accuracy of the student, it fails to transfer the superior out-of-distribution (OOD) generalization of the VLM teacher using the limited available labeled images. To mitigate this, we propose Vision-Language to Vision - Align, Distill, Predict (VL2V-ADiP), which first aligns the vision and language modalities of the teacher model with the vision modality of a pre-trained student model, and further distills the aligned VLM representations to the student. This maximally retains the pre-trained features of the student, while also incorporating the rich representations of the VLM image encoder and the superior generalization of the text embeddings. The proposed approach achieves state-of-the-art results on the standard Domain Generalization benchmarks in a black-box teacher setting as well as a white-box setting where the weights of the VLM are accessible.


title: Impact of Co-occurrence on Factual Knowledge of Large Language Models

abstract: Large language models (LLMs) often make factually incorrect responses despite their success in various applications. In this paper, we hypothesize that relying heavily on simple co-occurrence statistics of the pre-training corpora is one of the main factors that cause factual errors. Our results reveal that LLMs are vulnerable to the co-occurrence bias, defined as preferring frequently co-occurred words over the correct answer. Consequently, LLMs struggle to recall facts whose subject and object rarely co-occur in the pre-training dataset although they are seen during finetuning. We show that co-occurrence bias remains despite scaling up model sizes or finetuning. Therefore, we suggest finetuning on a debiased dataset to mitigate the bias by filtering out biased samples whose subject-object co-occurrence count is high. Although debiased finetuning allows LLMs to memorize rare facts in the training set, it is not effective in recalling rare facts unseen during finetuning. Further research in mitigation will help build reliable language models by preventing potential errors. The code is available at \url{https://github.com/CheongWoong/impact_of_cooccurrence}.


title: Exploring the interplay of technology, pro-family and prosocial behavior in settlement formation

abstract: We present an agent-based model that explores the relationship between pro-family and prosocial behaviors and their impact on settlement formation. The objective is to investigate how the technological level and various constraints influence the transition from pro-family to prosocial behavior. The model incorporates factors such as the specialization requirements of the technology, societal tolerance, and dynamic interactions within a synthetic population, where individuals have the choice to prioritize either their family or their own settlement. Agents' fitness is determined by two components: the proportion of pro-family agents within their family and the fraction of prosocial agents in their settlement, as well as its size. Our findings reveal that the transition from pro-family to prosocial behavior is driven by the technological level, and the developmental requirements of the technology shape the smoothness of this transition, ranging from abrupt to gradual. These results emphasize the significance of considering the interplay between the technological level, the nature of the technology, and cultural influences when examining settlement patterns and the dynamics of pro-family and prosocial behaviors in human societies.


title: A self-referenced optical phase noise analyzer for quantum technologies

abstract: Second generation quantum technologies aim to outperform classical alternatives by utilizing engineered quantum systems. Maintaining the coherence required to enable any quantum advantage requires detailed knowledge and control over the noise the hosting system is subjected to. Characterizing noise processes via their power spectral density is routinely done throughout science and technology and can be a demanding task. Determining the phase noise power spectrum in leading quantum technology platforms, for example, can be either outside the reach of many phase noise analyzers, or be prohibitively expensive. In this work, we present and characterize a cost-effective optical phase noise analyzer for quantum technology applications. Using this setup we compare two $\approx1\ \rm{Hz}$ linewidth ultra-stable oscillators near $729\ \rm{nm}$, using them as references to determine and discuss the noise floor achieved in this measurement apparatus with a focus on limitations and their tradeoffs. The achieved noise floor in this implementation of a low-cost, all-stock component, low-complexity phase noise analyzer compares favourably to commercial offerings. This setup can find application in particular without a more stable reference or operational quantum system as sensor as would be the case for many component manufacturers.


title: Invisible Threats: Backdoor Attack in OCR Systems

abstract: Optical Character Recognition (OCR) is a widely used tool to extract text from scanned documents. Today, the state-of-the-art is achieved by exploiting deep neural networks. However, the cost of this performance is paid at the price of system vulnerability. For instance, in backdoor attacks, attackers compromise the training phase by inserting a backdoor in the victim's model that will be activated at testing time by specific patterns while leaving the overall model performance intact. This work proposes a backdoor attack for OCR resulting in the injection of non-readable characters from malicious input images. This simple but effective attack exposes the state-of-the-art OCR weakness, making the extracted text correct to human eyes but simultaneously unusable for the NLP application that uses OCR as a preprocessing step. Experimental results show that the attacked models successfully output non-readable characters for around 90% of the poisoned instances without harming their performance for the remaining instances.


title: Impact of limited temporal resolution on 4D Monte Carlo dose calculation for intensity modulated proton therapy

abstract: The interplay between the beam delivery time structure and the patient motion makes 4D dose calculation (4DDC) important when treating moving tumors with intensity modulated proton therapy. 4DDC based on phase sorting of a 4DCT suffers from approximation errors in the assignment of spots to phases, since the temporal image resolution of the 4DCT is much lower than that of the delivery time structure. In this study we investigate and address this limitation by a method which applies registration-based interpolation between phase images to increase the temporal resolution of the 4DCT. First, each phase image is deformed toward its neighbor using the deformation vector field that aligns them, scaled by the desired time step. Then Monte Carlo-based 4DDC is performed on both the original 4DCT (10 phases), and extended 4DCTs at increasingly fine temporal resolutions. The method was evaluated on seven lung cancer patients treated with three robustly optimized beams, with simulated delivery time structures. Errors resulting from limited temporal resolution were measured by comparisons of doses computed using extended 4DCTs of various resolutions. The dose differences were quantified by gamma pass rates and volumes of the CTV that had dose differences above certain thresholds. The ground truth was taken as the dose computed using 100 phase images, and was justified by considering the diminishing effects of adding more images. The effect on dose-averaged linear energy transfer was also included in the analysis. A resolution of 20 (30) phase images per breathing cycle was sufficient to bring mean CTV $\gamma$-pass rates for $3\%/3$mm ($2\%/2$mm) above 99$\%$. For the patients with well behaved image data, mean CTV $\gamma$-pass rates for $1\%/1$mm surpassed 99$\%$ at a resolution of 50 images.


title: GraphAlign: Enhancing Accurate Feature Alignment by Graph matching for Multi-Modal 3D Object Detection

abstract: LiDAR and cameras are complementary sensors for 3D object detection in autonomous driving. However, it is challenging to explore the unnatural interaction between point clouds and images, and the critical factor is how to conduct feature alignment of heterogeneous modalities. Currently, many methods achieve feature alignment by projection calibration only, without considering the problem of coordinate conversion accuracy errors between sensors, leading to sub-optimal performance. In this paper, we present GraphAlign, a more accurate feature alignment strategy for 3D object detection by graph matching. Specifically, we fuse image features from a semantic segmentation encoder in the image branch and point cloud features from a 3D Sparse CNN in the LiDAR branch. To save computation, we construct the nearest neighbor relationship by calculating Euclidean distance within the subspaces that are divided into the point cloud features. Through the projection calibration between the image and point cloud, we project the nearest neighbors of point cloud features onto the image features. Then by matching the nearest neighbors with a single point cloud to multiple images, we search for a more appropriate feature alignment. In addition, we provide a self-attention module to enhance the weights of significant relations to fine-tune the feature alignment between heterogeneous modalities. Extensive experiments on nuScenes benchmark demonstrate the effectiveness and efficiency of our GraphAlign.


title: Proceedings of The 2023 Scheme and Functional Programming Workshop

abstract: This volume contains the articles presented at The 2023 Scheme and Functional Programming Workshop in Seattle, Washington on September 9, 2023. The program committee reviewed the articles using current academic standards and selected four articles for presentation. These proceedings are considered non-archival and the authors are free to submit revised versions of their articles to other venues for archival publication. Program Committee: Leif Andersen, Northeastern University; Mark Friedman Leilani Gilpin, University of California, Santa Cruz; Jason Hemann, Seton Hall University Julia Lawall, Inria; Joe Gibbs Politz, University of California at San Diego; Marco T Moraz\'an (Chair), Seton Hall University


title: Integrated Sensing and Communication enabled Sensing Base Station: System Design, Beamforming, Interference Cancellation and Performance Analysis

abstract: This paper studies the sensing base station (SBS) that has great potential to improve the safety of vehicles and pedestrians on roads. It can detect the targets on the road with communication signals using the integrated sensing and communication (ISAC) technique. Compared with vehicle-mounted radar, SBS has a better sensing field due to its higher deployment position, which can help solve the problem of sensing blind areas. In this paper, key technologies of SBS are studied, including the beamforming algorithm, beam scanning scheme, and interference cancellation algorithm. To transmit and receive ISAC signals simultaneously, a double-coupling antenna array is applied. The free detection beam and directional communication beam are proposed for joint communication and sensing to meet the requirements of beamwidth and pointing directions. The joint time-space-frequency domain division multiple access algorithm is proposed to cancel the interference of SBS, including multiuser interference and duplex interference between sensing and communication. Finally, the sensing and communication performance of SBS under the industrial scientific medical power limitation is analyzed and simulated. Simulation results show that the communication rate of SBS can reach over 100 Mbps and the range of sensing and communication can reach about 500 m.


title: Classification of solutions of higher order critical Choquard equation

abstract: In this paper, we classify the solutions of the following critical Choquard equation \[ (-\Delta)^{\frac{n}{2}} u(x) = \int_{\mathbb{R}^n} \frac{e^{\frac{2n- \mu}{2}u(y)}}{|x-y|^{\mu}}dy e^{\frac{2n- \mu}{2}u(x)}, \ \text{in} \ \mathbb{R}^n, \] where $ 0<\mu < n$, $ n\ge 2$. Suppose $ u(x) = o(|x|^2) \ \text{at} \ \infty $ for $ n \geq 3$ and satisfies \[ \int_{\mathbb{R}^n}e^{\frac{2n- \mu}{2}u(y)} dy < \infty, \ \int_{\mathbb{R}^n}\int_{\mathbb{R}^n}\frac{e^{\frac{2n- \mu}{2}u(y)}}{|x-y|^{\mu}} e^{\frac{2n- \mu}{2}u(x)} dy dx < \infty. \] By using the method of moving spheres, we show that the solutions have the following form \[ u(x)= \ln \frac{C_1(\varepsilon)}{|x-x_0|^2 + \varepsilon^2}. \]


title: Bilayer stanene on a magnetic topological insulator

abstract: A two-dimensional superconducting adlayer grown on a magnetic topological insulator (MTI) has the potential to exhibit proximity induced superconductivity, facilitate the existence of Majorana fermions and find applications in the field of quantum computing. In this work, we demonstrate the formation of bilayer stanene on an MTI substrate, specifically Mn(Bi$_{0.74}$Sb$_{0.26}$)$_2$Te$_4$ (MBST), through utilization of a combination of techniques such as angle-resolved photoemission spectroscopy (ARPES), scanning tunneling microscopy (STM), density functional theory (DFT), x-ray photoelectron spectroscopy (XPS), and low energy electron diffraction (LEED). The stanene related bands observed in ARPES have been corroborated by our DFT calculations. Atomic resolution STM topography images confirm the formation of monolayer as well as bilayer stanene. A buffer layer -- formed due to chemical bonding of Sn with the upper two layers of MBST (Te and Bi/Sb) -- facilitates the growth of stanene.


title: Growth and applications of two-dimensional single crystals

abstract: Two-dimensional (2D) materials have received extensive research attentions over the past two decades due to their intriguing physical properties (such as the ultrahigh mobility and strong light-matter interaction at atomic thickness) and a broad range of potential applications (especially in the fields of electronics and optoelectronics). The growth of single-crystal 2D materials is the prerequisite to realize 2D-based high-performance applications. In this review, we aim to provide an in-depth analysis of the state-of-the-art technology for the growth and applications of 2D materials, with particular emphasis on single crystals. We first summarize the major growth strategies for monolayer 2D single crystals. Following that, we discuss the growth of multilayer single crystals, including the control of thickness, stacking sequence, and heterostructure composition. Then we highlight the exploration of 2D single crystals in electronic and optoelectronic devices. Finally, a perspective is given to outline the research opportunities and the remaining challenges in this field.


title: Minimizing Sensor Allocation Cost for Crowdsensing On-street Parking Availability

abstract: In recent years, innovative roadside parking vacancy crowdsensing solutions have emerged as a cost-effective alternative to traditional methods, which can significantly reduce sensor installation and maintenance expenses. This crowdsensing scheme relies on vehicles equipped with sensors, such as buses and taxis, roaming around urban streets to detect on-street parking availability. Therefore, the accuracy of this scheme strongly depends on the vehicles' routes and the frequency of their passage through parking spots. This paper presents an integer programming-based optimal sensor allocation model to ensure the detection accuracy of the scheme while using the minimum number of sensing kits or probing vehicles. Moreover, a customized heuristic algorithm is proposed to hasten the solution process. Numerical simulations using the street dataset from San Francisco confirm the model's ability to reduce probing vehicle usage while ensuring detection accuracy. Thus, our approach represents an effective means of optimizing roadside parking detection in a crowdsensing way.


title: Change point detection in dynamic heterogeneous networks via subspace tracking

abstract: Dynamic networks consist of a sequence of time-varying networks, and it is of great importance to detect the network change points. Most existing methods focus on detecting abrupt change points, necessitating the assumption that the underlying network probability matrix remains constant between adjacent change points. This paper introduces a new model that allows the network probability matrix to undergo continuous shifting, while the latent network structure, represented via the embedding subspace, only changes at certain time points. Two novel statistics are proposed to jointly detect these network subspace change points, followed by a carefully refined detection procedure. Theoretically, we show that the proposed method is asymptotically consistent in terms of change point detection, and also establish the impossibility region for detecting these network subspace change points. The advantage of the proposed method is also supported by extensive numerical experiments on both synthetic networks and a UK politician social network.


title: The Lattice of Group Topologies on a Group

abstract: For an infinite group $G$, the set of group topologies, $\mathcal{L}_G$, forms a complete lattice. It is known that $\mathcal{L}_G$ is modular if $G$ is abelian but the same result does not hold for nilpotent groups. We prove that the lattice $\mathcal{L}_G$ is semi-modular if and only if $\mathcal{L}_{G/Z}$ is semi-modular, where $Z$ is the centre. As a corollary, for every nilpotent group $G$, the lattice $\mathcal{L}_G$ is semi-modular. Moreover, in the famous Kourovka Notebook, several questions about $\mathcal{L}_G$ were formalized by Arnautov. We answer two of them in this note.


title: Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction

abstract: Safe autonomous driving critically depends on how well the ego-vehicle can predict the trajectories of neighboring vehicles. To this end, several trajectory prediction algorithms have been presented in the existing literature. Many of these approaches output a multi-modal distribution of obstacle trajectories instead of a single deterministic prediction to account for the underlying uncertainty. However, existing planners cannot handle the multi-modality based on just sample-level information of the predictions. With this motivation, this paper proposes a trajectory optimizer that can leverage the distributional aspects of the prediction in a computationally tractable and sample-efficient manner. Our optimizer can work with arbitrarily complex distributions and thus can be used with output distribution represented as a deep neural network. The core of our approach is built on embedding distribution in Reproducing Kernel Hilbert Space (RKHS), which we leverage in two ways. First, we propose an RKHS embedding approach to select probable samples from the obstacle trajectory distribution. Second, we rephrase chance-constrained optimization as distribution matching in RKHS and propose a novel sampling-based optimizer for its solution. We validate our approach with hand-crafted and neural network-based predictors trained on real-world datasets and show improvement over the existing stochastic optimization approaches in safety metrics.


title: Variant Codes Based on A Special Polynomial Ring and Their Fast Computations

abstract: Binary array codes are widely used in storage systems to prevent data loss, such as the Redundant Array of Independent Disks~(RAID). Most designs for such codes, such as Blaum-Roth~(BR) codes and Independent-Parity~(IP) codes, are carried out on the polynomial ring F_2[x]/<\sum_{i=0}^{p-1}x^i >, where F_2 is a binary field, and p is a prime number. In this paper, we consider the polynomial ring F_2[x]/<\sum_{i=0}^{p-1}x^{i\tau}>, where p>1 is an odd number and \tau \geq 1 is any power of two, and explore variant codes from codes over this polynomial ring. Particularly, the variant codes are derived by mapping parity-check matrices over the polynomial ring to binary parity-check matrices. Specifically, we first propose two classes of variant codes, termed V-ETBR and V-ESIP codes. To make these variant codes binary maximum distance separable~(MDS) array codes that achieve optimal storage efficiency, this paper then derives the connections between them and their counterparts over polynomial rings. These connections are general, making it easy to construct variant MDS array codes from various forms of matrices over polynomial rings. Subsequently, some instances are explicitly constructed based on Cauchy and Vandermonde matrices. In the proposed constructions, both V-ETBR and V-ESIP MDS array codes can have any number of parity columns and have the total number of data columns of exponential order with respect to $p$. In terms of computation, two fast syndrome computations are proposed for the Vandermonde-based V-ETBR and V-ESIP MDS array codes, both meeting the lowest known asymptotic complexity among MDS codes. Due to the fact that all variant codes are constructed from parity-check matrices over simple binary fields instead of polynomial rings, they are attractive in practice.


title: From QFT to Boltzmann: Freeze-in in the presence of oscillating condensates

abstract: Scalar dark matter (DM), and axions in particular, have an irreducible abundance of particles produced by freeze-in due to portal interactions with the Standard Model plasma in the early Universe. In addition, vacuum misalignment and other mechanisms can lead to the presence of a cold, oscillating condensate. Therefore, generically, the evolution of the DM in both forms, condensate and particles, needs to be studied simultaneously. In non-equilibrium quantum field theory, the condensate and particles are described by one- and two-point functions, respectively. The fundamental coupled equations of motion (EoMs) of these objects are non-local. To simplify the EoMs and bring them into a familiar form for relic abundance calculations, we perform a Markovianization process for a quasi-harmonically oscillating homogeneous condensate, leading to local EoMs for the particle distribution function and the envelope function of condensate oscillation. This reduces the dynamics to a pair of coupled Boltzmann equations, and we derive explicitly the form of the collision operators for all particle and condensate interactions.


title: Five years of 6.7 GHz methanol maser monitoring with Irbene radio telescopes

abstract: We present the results of a 5-year monitoring program of 42 sources targeted at 6.7 GHz methanol masers, conducted from March 2017 to October 2022 using the Irbene 32 and 16 meter radio telescopes. Sources were observed with irregular intervals where time between two consecutive observation ranged from twenty four hours to thirty five days. We found that more than 55 per cent of the sources showed significant variability, but often only one or a few spectral features were varying significantly. Numerous type of variability were found in our sample: low-variable, periodic, irregular, synchronised and anti-correlated between features and steadily raising or falling flux. Our analysis techniques also uncover new variability trends for several sources. The maser monitoring program is one of the first single-dish science initiatives at the Irbene radio telescope complex, initiated shortly after the instrument's reconstruction and upgrades. Our findings unequivocally demonstrate its suitability for maser research purposes.


title: Von Neumann Stability Analysis for Multi-level Multi-step Methods

abstract: Von Neumann stability analysis, a well-known Fourier-based method, is a widely used technique for assessing stability in numerical computations. However, as noted in "Numerical Solution of Partial Differential Equations: Finite Difference Methods" by Smith (1985, pp. 67-68), this approach faces limitations when applied to multi-level methods employing schemes with more than two levels. In this study, we aim to extend the applicability of Von Neumann stability analysis to multi-level methods. An alternative method closely related to Von Neumann stability analysis is the Approximate Dispersion Relation (ADR) analysis. In this work, we not only explore ADR analysis but also introduce various ADR analysis variants while examining their inherent limitations so that other researchers can improve the analysis before using that in their work. Furthermore, we propose an innovative strategy for reducing dissipation, optimizing it through the use of an evolutionary algorithm. Our findings demonstrate that our proposed method yields minimal errors when compared to other advection equation schemes, both in one and two spatial dimensions.


title: Harnessing the Power of LLM to Support Binary Taint Analysis

abstract: This paper proposes LATTE, the first static binary taint analysis that is powered by a large language model (LLM). LATTE is superior to the state of the art (e.g., Emtaint, Arbiter, Karonte) in three aspects. First, LATTE is fully automated while prior static binary taint analyzers need rely on human expertise to manually customize taint propagation rules and vulnerability inspection rules. Second, LATTE is significantly effective in vulnerability detection, demonstrated by our comprehensive evaluations. For example, LATTE has found 37 new bugs in real-world firmware which the baselines failed to find, and 7 of them have been assigned CVE numbers. Lastly, LATTE incurs remarkably low engineering cost, making it a cost-efficient and scalable solution for security researchers and practitioners. We strongly believe that LATTE opens up a new direction to harness the recent advance in LLMs to improve vulnerability analysis for binary programs.


title: Direction-Oriented Visual-semantic Embedding Model for Remote Sensing Image-text Retrieval

abstract: Image-text retrieval has developed rapidly in recent years. However, it is still a challenge in remote sensing due to visual-semantic imbalance, which leads to incorrect matching of non-semantic visual and textual features. To solve this problem, we propose a novel Direction-Oriented Visual-semantic Embedding Model (DOVE) to mine the relationship between vision and language. Our highlight is to conduct visual and textual representations in latent space, directing them as close as possible to a redundancy-free regional visual representation. Concretely, a Regional-Oriented Attention Module (ROAM) adaptively adjusts the distance between the final visual and textual embeddings in the latent semantic space, oriented by regional visual features. Meanwhile, a lightweight Digging Text Genome Assistant (DTGA) is designed to expand the range of tractable textual representation and enhance global word-level semantic connections using less attention operations. Ultimately, we exploit a global visual-semantic constraint to reduce single visual dependency and serve as an external constraint for the final visual and textual representations. The effectiveness and superiority of our method are verified by extensive experiments including parameter evaluation, quantitative comparison, ablation studies and visual analysis, on two benchmark datasets, RSICD and RSITMD.


title: A Single Speech Enhancement Model Unifying Dereverberation, Denoising, Speaker Counting, Separation, and Extraction

abstract: We propose a multi-task universal speech enhancement (MUSE) model that can perform five speech enhancement (SE) tasks: dereverberation, denoising, speech separation (SS), target speaker extraction (TSE), and speaker counting. This is achieved by integrating two modules into an SE model: 1) an internal separation module that does both speaker counting and separation; and 2) a TSE module that extracts the target speech from the internal separation outputs using target speaker cues. The model is trained to perform TSE if the target speaker cue is given and SS otherwise. By training the model to remove noise and reverberation, we allow the model to tackle the five tasks mentioned above with a single model, which has not been accomplished yet. Evaluation results demonstrate that the proposed MUSE model can successfully handle multiple tasks with a single model.


title: Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

abstract: Over the past years, foundation models have caused a paradigm shift in machine learning due to their unprecedented capabilities for zero-shot and few-shot generalization. However, despite the success of foundation models in modalities such as natural language processing and computer vision, the development of foundation models for time series forecasting has lagged behind. We present Lag-Llama, a general-purpose foundation model for univariate probabilistic time series forecasting based on a decoder-only transformer architecture that uses lags as covariates. Lag-Llama is pretrained on a large corpus of diverse time series data from several domains, and demonstrates strong zero-shot generalization capabilities compared to a wide range of forecasting models on downstream datasets across domains. Moreover, when fine-tuned on relatively small fractions of such previously unseen datasets, Lag-Llama achieves state-of-the-art performance, outperforming prior deep learning approaches, emerging as the best general-purpose model on average. Lag-Llama serves as a strong contender to the current state-of-art in time series forecasting and paves the way for future advancements in foundation models tailored to time series data.


title: Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancement

abstract: The design and development of text-based knowledge graph completion (KGC) methods leveraging textual entity descriptions are at the forefront of research. These methods involve advanced optimization techniques such as soft prompts and contrastive learning to enhance KGC models. The effectiveness of text-based methods largely hinges on the quality and richness of the training data. Large language models (LLMs) can utilize straightforward prompts to alter text data, thereby enabling data augmentation for KGC. Nevertheless, LLMs typically demand substantial computational resources. To address these issues, we introduce a framework termed constrained prompts for KGC (CP-KGC). This CP-KGC framework designs prompts that adapt to different datasets to enhance semantic richness. Additionally, CP-KGC employs a context constraint strategy to effectively identify polysemous entities within KGC datasets. Through extensive experimentation, we have verified the effectiveness of this framework. Even after quantization, the LLM (Qwen-7B-Chat-int4) still enhances the performance of text-based KGC methods \footnote{Code and datasets are available at \href{https://github.com/sjlmg/CP-KGC}{https://github.com/sjlmg/CP-KGC}}. This study extends the performance limits of existing models and promotes further integration of KGC with LLMs.


title: Optimizing Odia Braille Literacy: The Influence of Speed on Error Reduction and Enhanced Comprehension

abstract: This study aims to conduct an extensive detailed analysis of the Odia Braille reading comprehension among students with visual disability. Specifically, the study explores their reading speed and hand or finger movements. The study also aims to investigate any comprehension difficulties and reading errors they may encounter. Six students from the 9th and 10th grades, aged between 14 and 16, participated in the study. We observed participants hand movements to understand how reading errors were connected to hand movement and identify the students reading difficulties. We also evaluated the participants Odia Braille reading skills, including their reading speed (in words per minute), errors, and comprehension. The average speed of Odia Braille reader is 17.64wpm. According to the study, there was a noticeable correlation between reading speed and reading errors. As reading speed decreased, the number of reading errors tended to increase. Moreover, the study established a link between reduced Braille reading errors and improved reading comprehension. In contrast, the study found that better comprehension was associated with increased reading speed. The researchers concluded with some interesting findings about preferred Braille reading patterns. These findings have important theoretical, developmental, and methodological implications for instruction.


title: Energy deposition studies for the Upgrade II of LHCb at the CERN Large Hadron Collider

abstract: The Upgrade II of the LHCb experiment is proposed to be installed during the CERN Long Shutdown 4, aiming to operate LHCb at 1.5x$10^{34}cm^{-2}s^{-1}$ that is 75 times its design luminosity and reaching an integrated luminosity of about $400 fb^{-1}$ by the end of the High Luminosity LHC era. This increase of the data sample at LHCb is an unprecedented opportunity for heavy flavour physics measurements. A first upgrade of LHCb, completed in 2022, has already implemented important changes of the LHCb detector and, for the Upgrade II, further detector improvements are being considered. Such a luminosity increase will have an impact not only on the LHCb detector but also on the LHC magnets, cryogenics and electronic equipment placed in the IR8. In fact, the LHCb experiment was conceived to work at a much lower luminosity than ATLAS and CMS, implying minor requirements for protection of the LHC elements from the collision debris and therefore a different layout around the interaction point. The luminosity target proposed for the Upgrade II requires to review the layout of the entire insertion region in order to ensure safe operation of the LHC magnets and to mitigate the risk of failure of the electronic devices. The objective of this paper is to provide an overview of the implications of the Upgrade II of LHCb in the experimental cavern and in the tunnel with a focus on the LHCb detector, electronic devices and accelerator magnets.


title: Data driven modeling for self-similar dynamics

abstract: Multiscale modeling of complex systems is crucial for understanding their intricacies. Data-driven multiscale modeling has emerged as a promising approach to tackle challenges associated with complex systems. On the other hand, self-similarity is prevalent in complex systems, hinting that large-scale complex systems can be modeled at a reduced cost. In this paper, we introduce a multiscale neural network framework that incorporates self-similarity as prior knowledge, facilitating the modeling of self-similar dynamical systems. For deterministic dynamics, our framework can discern whether the dynamics are self-similar. For uncertain dynamics, it can compare and determine which parameter set is closer to self-similarity. The framework allows us to extract scale-invariant kernels from the dynamics for modeling at any scale. Moreover, our method can identify the power law exponents in self-similar systems. Preliminary tests on the Ising model yielded critical exponents consistent with theoretical expectations, providing valuable insights for addressing critical phase transitions in non-equilibrium systems.


title: Diamonds: Homology and the Central Series of Groups

abstract: We establish an analog of a theorem of Stallings which asserts the homomorphisms between the universal nilpotent quotients induced by a homomorphism $G \to H$ of groups are isomorphisms provided a pair of homological conditions are satisfied. Our analogy does not have a homomorphism between $G$ and $H$ but instead we have a diamond of groups containing $G,H$ that satisfies a similar homological condition. We derive a few applications of this result. First, we show that there exist non-isomorphic number fields whose absolute Galois groups have isomorphic universal nilpotent quotients. We show that there exists pairs of non-isometric hyperbolic $n$-manifolds whose fundamental groups are residually nilpotent and have isomorphic universal nilpotent quotients. These are the first examples of residually nilpotent Kleinian groups with arbitrarily large nilpotent genus. Complex hyperbolic 2-manifold examples are given which also supply examples of surfaces whose geometric fundamental groups have the isomorphic universal nilpotent quotients and the isomorphisms are compatible with the outer Galois actions. The case of Riemann surfaces provides examples of curves where the same implication holds. In fact, for every $g \geq 2$, we show all but finitely many curves in $\mathcal{M}_g$ have finite covers where this happens.


title: Statistical arbitrage portfolio construction based on preference relations

abstract: Statistical arbitrage methods identify mispricings in securities with the goal of building portfolios which are weakly correlated with the market. In pairs trading, an arbitrage opportunity is identified by observing relative price movements between a pair of two securities. By simultaneously observing multiple pairs, one can exploit different arbitrage opportunities and increase the performance of such methods. However, the use of a large number of pairs is difficult due to the increased probability of contradictory trade signals among different pairs. In this paper, we propose a novel portfolio construction method based on preference relation graphs, which can reconcile contradictory pairs trading signals across multiple security pairs. The proposed approach enables joint exploitation of arbitrage opportunities among a large number of securities. Experimental results using three decades of historical returns of roughly 500 stocks from the S\&P 500 index show that the portfolios based on preference relations exhibit robust returns even with high transaction costs, and that their performance improves with the number of securities considered.


title: How would mobility-as-a-service (MaaS) platform survive as an intermediary? From the viewpoint of stability in many-to-many matching

abstract: Mobility-as-a-service (MaaS) provides seamless door-to-door trips by integrating different transport modes. Although many MaaS platforms have emerged in recent years, most of them remain at a limited integration level. This study investigates the assignment and pricing problem for a MaaS platform as an intermediary in a multi-modal transportation network, which purchases capacity from service operators and sells multi-modal trips to travelers. The analysis framework of many-to-many stable matching is adopted to decompose the joint design problem and to derive the stability condition such that both operators and travelers are willing to participate in the MaaS system. To maximize the flexibility in route choice and remove boundaries between modes, we design an origin-destination pricing scheme for MaaS trips. On the supply side, we propose a wholesale purchase price for service capacity. Accordingly, the assignment problem is reformulated and solved as a bi-level program, where MaaS travelers make multi-modal trips to minimize their travel costs meanwhile interacting with non-MaaS travelers in the multi-modal transport system. We prove that, under the proposed pricing scheme, there always exists a stable outcome to the overall many-to-many matching problem. Further, given an optimal assignment and under some mild conditions, a unique optimal pricing scheme is ensured. Numerical experiments conducted on the extended Sioux Falls network also demonstrate that the proposed MaaS system could create a win-win-win situation -- the MaaS platform is profitable and both traveler welfare and transit operator revenues increase from a baseline scenario without MaaS.


title: Observations of transient wave-induced mean drift profiles caused by virtual wave stresses in a two-layer system

abstract: An experimental study of long interfacial gravity waves was conducted in a closed wave tank containing two layers of viscous immiscible fluids. The study focuses on the development in time of the mean particle drift that occurs close to the interface where the two fluids meet. From a theoretical analysis by Weber & Christensen (Eur. J. Mech.-B/Fluids, vol. 77, 2019, pp. 162-170) it is predicted that the growing drift in this region is associated with the action of the virtual wave stress. This effect has not been explored experimentally before. Interfacial waves of different amplitudes and frequencies were produced by a D-shaped paddle. Particle tracking velocimetry (PTV) was used to track the time development of the Lagrangian mean drift. The finite geometry of the wave tank causes a mean return flow that is resolved by mass transport considerations. The measurements clearly demonstrate the importance of the virtual wave stress mechanism in generating wave drift currents near the interface.


title: A Symmetry-Aware Exploration of Bayesian Neural Network Posteriors

abstract: The distribution of the weights of modern deep neural networks (DNNs) - crucial for uncertainty quantification and robustness - is an eminently complex object due to its extremely high dimensionality. This paper proposes one of the first large-scale explorations of the posterior distribution of deep Bayesian Neural Networks (BNNs), expanding its study to real-world vision tasks and architectures. Specifically, we investigate the optimal approach for approximating the posterior, analyze the connection between posterior quality and uncertainty quantification, delve into the impact of modes on the posterior, and explore methods for visualizing the posterior. Moreover, we uncover weight-space symmetries as a critical aspect for understanding the posterior. To this extent, we develop an in-depth assessment of the impact of both permutation and scaling symmetries that tend to obfuscate the Bayesian posterior. While the first type of transformation is known for duplicating modes, we explore the relationship between the latter and L2 regularization, challenging previous misconceptions. Finally, to help the community improve our understanding of the Bayesian posterior, we will shortly release the first large-scale checkpoint dataset, including thousands of real-world models and our codes.


title: Quantum random access memory architectures using superconducting cavities

abstract: Quantum random access memory (QRAM) is a common architecture resource for algorithms with many proposed applications, including quantum chemistry, windowed quantum arithmetic, unstructured search, machine learning, and quantum cryptography. Here we propose two bucket-brigade QRAM architectures based on high-coherence superconducting resonators, which differ in their realizations of the conditional-routing operations. In the first, we directly construct controlled-$\mathsf{SWAP}$ ($\textsf{CSWAP}$) operations, while in the second we utilize the properties of giant-unidirectional emitters (GUEs). For both architectures we analyze single-rail and dual-rail implementations of a bosonic qubit. In the single-rail encoding we can detect first-order ancilla errors, while the dual-rail encoding additionally allows for the detection of photon losses. For parameter regimes of interest the post-selected infidelity of a QRAM query in a dual-rail architecture is nearly an order of magnitude below that of a corresponding query in a single-rail architecture. These findings suggest that dual-rail encodings are particularly attractive as architectures for QRAM devices in the era before fault tolerance.


title: Maximization of minimum rate in MIMO OFDM RIS-assisted Broadcast Channels

abstract: Reconfigurable intelligent surface (RIS) is a promising technology to enhance the spectral efficiency of wireless communication systems. By optimizing the RIS elements, the performance of the overall system can be improved. Yet, in contrast to single-carrier systems, in multi-carrier systems, it is not possible to independently optimize RIS elements at each sub-carrier, which may reduce the benefits of RIS in multi-user orthogonal frequency division multiplexing (OFDM) systems. To this end, we investigate the effectiveness of RIS in multiple-input, multiple-output (MIMO) OFDM broadcast channels (BC). We formulate and solve a joint precoding and RIS optimization problem. We show that RIS can significantly improve the system performance even when the number of RIS elements per sub-band is very low.


title: Stabilization of a locally transmission problems of two strongly-weakly coupled wave systems

abstract: In this paper, we embark on a captivating exploration of the stabilization of locally transmitted problems within the realm of two interconnected wave systems. To begin, we wield the formidable Arendt-Batty criteria\cite{AW} to affirm the resolute stability of our system. Then, with an artful fusion of a frequency domain approach and the multiplier method, we unveil the exquisite phenomenon of exponential stability, a phenomenon that manifests when the waves of the second system synchronize their propagation speeds. In cases where these speeds diverge, our investigation reveals a graceful decay of our system's energy, elegantly characterized by a polynomial decline at a rate of $t^{-1}$.


title: Expanding the Vocabulary of BERT for Knowledge Base Construction

abstract: Knowledge base construction entails acquiring structured information to create a knowledge base of factual and relational data, facilitating question answering, information retrieval, and semantic understanding. The challenge called "Knowledge Base Construction from Pretrained Language Models" at International Semantic Web Conference 2023 defines tasks focused on constructing knowledge base using language model. Our focus was on Track 1 of the challenge, where the parameters are constrained to a maximum of 1 billion, and the inclusion of entity descriptions within the prompt is prohibited. Although the masked language model offers sufficient flexibility to extend its vocabulary, it is not inherently designed for multi-token prediction. To address this, we present Vocabulary Expandable BERT for knowledge base construction, which expand the language model's vocabulary while preserving semantic embeddings for newly added words. We adopt task-specific re-pre-training on masked language model to further enhance the language model. Through experimentation, the results show the effectiveness of our approaches. Our framework achieves F1 score of 0.323 on the hidden test set and 0.362 on the validation set, both data set is provided by the challenge. Notably, our framework adopts a lightweight language model (BERT-base, 0.13 billion parameters) and surpasses the model using prompts directly on large language model (Chatgpt-3, 175 billion parameters). Besides, Token-Recode achieves comparable performances as Re-pretrain. This research advances language understanding models by enabling the direct embedding of multi-token entities, signifying a substantial step forward in link prediction task in knowledge graph and metadata completion in data management.


title: Concealed Electronic Countermeasures of Radar Signal with Adversarial Examples

abstract: Electronic countermeasures involving radar signals are an important aspect of modern warfare. Traditional electronic countermeasures techniques typically add large-scale interference signals to ensure interference effects, which can lead to attacks being too obvious. In recent years, AI-based attack methods have emerged that can effectively solve this problem, but the attack scenarios are currently limited to time domain radar signal classification. In this paper, we focus on the time-frequency images classification scenario of radar signals. We first propose an attack pipeline under the time-frequency images scenario and DITIMI-FGSM attack algorithm with high transferability. Then, we propose STFT-based time domain signal attack(STDS) algorithm to solve the problem of non-invertibility in time-frequency analysis, thus obtaining the time-domain representation of the interference signal. A large number of experiments show that our attack pipeline is feasible and the proposed attack method has a high success rate.


title: Full intrinsic quadrics of dimension two

abstract: A full intrinsic quadric is a normal complete variety with a finitely generated Cox ring defined by a single quadratic relation of full rank. We describe all surfaces of this type explicitly via local Gorenstein indices. As applications, we present upper and lower bounds in terms of the Gorenstein index for the degree, the log canonicity and the Picard index. Moreover, we determine all full intrinsic quadric surfaces admitting a K\"ahler-Einstein metric.


title: Rotating convection and flows with horizontal kinetic energy backscatter

abstract: Numerical simulations of large scale geophysical flows typically require unphysically strong dissipation for numerical stability. Towards energetic balance various schemes have been devised to re-inject this energy, in particular by horizontal kinetic energy backscatter. In a set of papers, some of the authors have studied this scheme through its continuum formulation with momentum equations augmented by a backscatter operator, e.g. in rotating Boussinesq and shallow water equations. Here we review the main results about the impact of backscatter on certain flows and waves, including some barotropic, parallel and Kolmogorow flows, as well as internal gravity waves and geostrophic equilibria. We particularly focus on the possible accumulation of injected energy in explicit medium scale plane waves, which then grow exponentially and unboundedly, or yield bifurcations in the presence of bottom drag. Beyond the review, we introduce the rotating 2D Euler equations with backscatter as a guiding example. For this we prove the new result that unbounded growth is a stable phenomenon occurring in open sets of phase space. We also briefly consider the primitive equations with backscatter and outline global well-posedness results.


title: If our aim is to build morality into an artificial agent, how might we begin to go about doing so?

abstract: As Artificial Intelligence (AI) becomes pervasive in most fields, from healthcare to autonomous driving, it is essential that we find successful ways of building morality into our machines, especially for decision-making. However, the question of what it means to be moral is still debated, particularly in the context of AI. In this paper, we highlight the different aspects that should be considered when building moral agents, including the most relevant moral paradigms and challenges. We also discuss the top-down and bottom-up approaches to design and the role of emotion and sentience in morality. We then propose solutions including a hybrid approach to design and a hierarchical approach to combining moral paradigms. We emphasize how governance and policy are becoming ever more critical in AI Ethics and in ensuring that the tasks we set for moral agents are attainable, that ethical behavior is achieved, and that we obtain good AI.


title: Construction of integrable generalised travelling wave models and analytical solutions using Lie symmetries

abstract: Certain solutions of autonomous PDEs without any boundary conditions describing the spatiotemporal evolution of a dependent variable in an unbounded spatial domain can be characterised as a travelling wave moving with constant speed. In the simplest case, such PDEs can be reduced to a single autonomous second order ODE with one dependent variable. For certain parameter values it has been shown using perturbations methods in combination with ans\"{a}tze that numerous such second order ODEs have analytical travelling wave solutions described by a simple sigmoid function. However, this methodology provides no leverage on the problem of finding a generalised class of models possessing such analytical travelling wave solutions. The most efficient methods for both finding analytical solutions and constructing classes of ODEs are based on Lie symmetries which are transformations known as one parameter $\mathcal{C}^{\infty}$ diffeomorphisms mapping solutions to other solutions. Recently, analytical solutions of a second order ODE encapsulating numerous oscillatory models as well as some of the previously mentioned travelling wave models with simple analytical solutions have been found by means of a two dimensional Lie algebra. Based on this Lie algebra, we construct the most general class of integrable autonomous second order ODEs for which these symmetries are manifest. Moreover, we show that a sub-class of second order ODEs has simple analytical travelling wave solutions described by a sigmoid function. Lastly, we characterise the action of the two symmetries in this Lie algebra on these simple analytical travelling wave solutions and we relate our sub-class of ODEs to previously known integrable travelling wave models.


title: Elliptic Equations in Divergence Form with Discontinuous Coefficients in Domains with Corners

abstract: We study the equations in divergence form with piecewise $C^{\ga}$ coefficients. The domains contain corners and the discontinuity surfaces are attached to edges of the corners. We obtain piecewise $C^{1,\ga}$ estimates across the discontinuity surfaces and provide an example to illustrate the issue about the regularity at the corners.


title: MProto: Multi-Prototype Network with Denoised Optimal Transport for Distantly Supervised Named Entity Recognition

abstract: Distantly supervised named entity recognition (DS-NER) aims to locate entity mentions and classify their types with only knowledge bases or gazetteers and unlabeled corpus. However, distant annotations are noisy and degrade the performance of NER models. In this paper, we propose a noise-robust prototype network named MProto for the DS-NER task. Different from previous prototype-based NER methods, MProto represents each entity type with multiple prototypes to characterize the intra-class variance among entity representations. To optimize the classifier, each token should be assigned an appropriate ground-truth prototype and we consider such token-prototype assignment as an optimal transport (OT) problem. Furthermore, to mitigate the noise from incomplete labeling, we propose a novel denoised optimal transport (DOT) algorithm. Specifically, we utilize the assignment result between Other class tokens and all prototypes to distinguish unlabeled entity tokens from true negatives. Experiments on several DS-NER benchmarks demonstrate that our MProto achieves state-of-the-art performance. The source code is now available on Github.


title: New splittings of operations of Poisson algebras and transposed Poisson algebras and related algebraic structures

abstract: There are two kinds of splittings of operations, namely, the classical splitting which is interpreted operadically as taking successors and another splitting which we call the second splitting giving the anti-structures of the successors' algebras. The algebraic structures corresponding to them respectively are characterized in terms of representations. Due to the appearance of the two bilinear operations in Poisson algebras and transposed Poisson algebras, we commence to study new splittings of operations in the ``mixed" sense that the commutative associative products and Lie brackets are splitted in different manners respectively, that is, they are splitted interlacedly in three manners: the classical splitting, the second splitting and the un-splitting. Accordingly the corresponding algebraic structures are given. More explicitly, there are 8 algebraic structures interpreted in terms of representations of Poisson algebras illustrating the mixed splittings of operations of Poisson algebras respectively, including the known pre-Poisson algebras. For illustrating the mixed splittings of operations of transposed Poisson algebras, there are 8 algebraic structures interpreted in terms of representations of transposed Poisson algebras on the spaces themselves and another 8 algebraic structures interpreted in terms of representations of transposed Poisson algebras on the dual spaces. Moreover, such a phenomenon exhibits an obvious difference between Poisson algebras and transposed Poisson algebras.


title: Existence of constant mean curvature disks in $\mathbb{R}^3$ with capillary boundary condition

abstract: We extend Struwe's result (Acta Math., 1988) on the existence of free boundary constant mean curvature disks to almost every prescribed boundary contact angle in $(0, \pi)$. Specifically, let $\Sigma$ be a surface in $\mathbb{R}^3$ diffeomorphic to the sphere, and let $\Sigma'$ be a convex surface enclosing $\Sigma$. Given $\tau \in (-1, 1)$ and a constant $H \geq 0$ below the infimum of the mean curvature of $\Sigma'$, we show that for almost every $r \in (0, 1)$, in the region enclosed by $\Sigma'$ there exists a branched immersed disk with constant mean curvature $rH$ whose boundary meets $\Sigma$ at an angle with cosine value $r\tau$. Moreover, the constant mean curvature disks we construct have index at most $1$.


title: Rotational symmetry of ancient solutions to fully nonlinear curvature flows

abstract: We address the classification of ancient solutions to fully nonlinear curvature flows for hypersurfaces. Under natural conditions on the speed of motion we classify ancient solutions which are convex, noncollapsing, uniformly two-convex and noncompact. There are exactly two possibilities -- every such solution is either a self-similarly shrinking cylinder, or else is a rotationally symmetric translating soliton. For a large class of flows this yields a complete classification of the blow-up limits that can arise at a singularity of a solution which is compact, embedded and two-convex.


title: Deep Learning for EELS hyperspectral images unmixing -- using autoencoders

abstract: Spatially resolved Electron Energy-Loss Spectroscopy (EELS) conducted in a Scanning Transmission Electron Microscope (STEM) enables the acquisition of hyperspectral images (HSIs). Spectral unmixing (SU) is the process of decomposing each spectrum of an HSI into a combination of representative spectra (endmembers) corresponding to compounds present in the sample along with their local proportions (abundances). SU is a complex task, and various methods have been developed in different communities using HSIs. However, none of these methods fully satisfy the STEM-EELS requirements. Recent advancements in remote sensing, which focus on Deep Learning techniques, have the potential to meet these requirements, particularly Autoencoders (AEs). In this study, the performance of Deep Learning methods using AE for SU is evaluated, and their results are compared with traditional methods. Synthetic HSIs have been created to quantitatively assess the outcomes of the unmixing process using specific metrics. The methods are subsequently applied to a series of experimental data. The findings demonstrate the promising potential of AE as a tool for STEM-EELS SU, marking a starting point for exploring more sophisticated Neural Networks.


title: Multimodal Variational Auto-encoder based Audio-Visual Segmentation

abstract: We propose an Explicit Conditional Multimodal Variational Auto-Encoder (ECMVAE) for audio-visual segmentation (AVS), aiming to segment sound sources in the video sequence. Existing AVS methods focus on implicit feature fusion strategies, where models are trained to fit the discrete samples in the dataset. With a limited and less diverse dataset, the resulting performance is usually unsatisfactory. In contrast, we address this problem from an effective representation learning perspective, aiming to model the contribution of each modality explicitly. Specifically, we find that audio contains critical category information of the sound producers, and visual data provides candidate sound producer(s). Their shared information corresponds to the target sound producer(s) shown in the visual data. In this case, cross-modal shared representation learning is especially important for AVS. To achieve this, our ECMVAE factorizes the representations of each modality with a modality-shared representation and a modality-specific representation. An orthogonality constraint is applied between the shared and specific representations to maintain the exclusive attribute of the factorized latent code. Further, a mutual information maximization regularizer is introduced to achieve extensive exploration of each modality. Quantitative and qualitative evaluations on the AVSBench demonstrate the effectiveness of our approach, leading to a new state-of-the-art for AVS, with a 3.84 mIOU performance leap on the challenging MS3 subset for multiple sound source segmentation.


title: CHIP: Contrastive Hierarchical Image Pretraining

abstract: Few-shot object classification is the task of classifying objects in an image with limited number of examples as supervision. We propose a one-shot/few-shot classification model that can classify an object of any unseen class into a relatively general category in an hierarchically based classification. Our model uses a three-level hierarchical contrastive loss based ResNet152 classifier for classifying an object based on its features extracted from Image embedding, not used during the training phase. For our experimentation, we have used a subset of the ImageNet (ILSVRC-12) dataset that contains only the animal classes for training our model and created our own dataset of unseen classes for evaluating our trained model. Our model provides satisfactory results in classifying the unknown objects into a generic category which has been later discussed in greater detail.


title: Fitting Stochastic Lattice Models Using Approximate Gradients

abstract: Stochastic lattice models (sLMs) are computational tools for simulating spatiotemporal dynamics in physics, computational biology, chemistry, ecology, and other fields. Despite their widespread use, it is challenging to fit sLMs to data, as their likelihood function is commonly intractable and the models non-differentiable. The adjacent field of agent-based modelling (ABM), faced with similar challenges, has recently introduced an approach to approximate gradients in network-controlled ABMs via reparameterization tricks. This approach enables efficient gradient-based optimization with automatic differentiation (AD), which allows for a directed local search of suitable parameters rather than estimation via black-box sampling. In this study, we investigate the feasibility of using similar reparameterization tricks to fit sLMs through backpropagation of approximate gradients. We consider four common scenarios: fitting to single-state transitions, fitting to trajectories, inference of lattice states, and identification of stable lattice configurations. We demonstrate that all tasks can be solved by AD using four example sLMs from sociology, biophysics, image processing, and physical chemistry. Our results show that AD via approximate gradients is a promising method to fit sLMs to data for a wide variety of models and tasks.


title: LimberJack.jl: auto-differentiable methods for angular power spectra analyses

abstract: We present LimberJack.jl, a fully auto-differentiable code for cosmological analyses of 2 point auto- and cross-correlation measurements from galaxy clustering, CMB lensing and weak lensing data written in Julia. Using Julia's auto-differentiation ecosystem, LimberJack.jl can obtain gradients for its outputs up to an order of magnitude faster than traditional finite difference methods. This makes LimberJack.jl greatly synergistic with gradient-based sampling methods, such as Hamiltonian Monte Carlo, capable of efficiently exploring parameter spaces with hundreds of dimensions. We first prove LimberJack.jl's reliability by reanalysing the DES Y1 3$\times$2-point data. We then showcase its capabilities by using a O(100) parameters Gaussian Process to reconstruct the cosmic growth from a combination of DES Y1 galaxy clustering and weak lensing data, eBOSS QSO's, CMB lensing and redshift-space distortions. Our Gaussian process reconstruction of the growth factor is statistically consistent with the $\Lambda$CDM Planck 2018 prediction at all redshifts. Moreover, we show that the addition of RSD data is extremely beneficial to this type of analysis, reducing the uncertainty in the reconstructed growth factor by $20\%$ on average across redshift. LimberJack.jl is a fully open-source project available on Julia's general repository of packages and GitHub.


title: Selective Wigner phase space tomography and its application for studying quantum chaos

abstract: The quasiprobability distribution of the discrete Wigner function provides a complete description of a quantum state and is, therefore, a useful alternative to the usual density matrix description. Moreover, the experimental quantum state tomography in discrete Wigner phase space can also be implemented. We observe that for a certain class of states, such as harmonic states, the Wigner matrix is far more sparse compared to the density matrix in the computational basis. Additionally, reading only a small part of the Wigner matrix may suffice to infer certain behavior of quantum dynamics. In such cases, selective Wigner phase space tomography (SWPST) can be more efficient than the usual density matrix tomography (DMT). Employing nuclear magnetic resonance methods on a three-qubit nuclear spin register, we experimentally estimate Wigner matrices of various two-qubit quantum states. As a specific example application of SWPST, we study the evolution of spin coherent states under the quantum chaotic kicked top model and extract signatures of quantum-classical correspondence in the Wigner phase space.


title: Multicriteria Optimization of Lower Limb Exoskeleton Mechanism

abstract: Typical leg exoskeletons employ open-loop kinematic chains with motors placed directly on movable joints; while this design offers flexibility, it leads to increased costs and heightened control complexity due to the high number of degrees of freedom. The use of heavy servo-motors to handle torque in active joints results in complex and bulky designs, as highlighted in existing literature. In this study, we introduced a novel synthesis method with analytical solutions provided for synthesizing lower-limb exoskeleton. Additionally, we have incorporated multicriteria optimization by six designing criteria. As a result, we offer several mechanisms, comprising only six links, well-suited to the human anatomical structure, exhibit superior trajectory accuracy, efficient force transmission, satisfactory step height, and having internal transfer segment of the foot.


title: Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning

abstract: Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence. Nonetheless, the current practice of ICL treats all demonstration examples equally, which still warrants improvement, as the quality of examples is usually uneven. In this paper, we investigate how to determine approximately optimal weights for demonstration examples and how to apply them during ICL. To assess the quality of weights in the absence of additional validation data, we design a masked self-prediction (MSP) score that exhibits a strong correlation with the final ICL performance. To expedite the weight-searching process, we discretize the continuous weight space and adopt beam search. With approximately optimal weights obtained, we further propose two strategies to apply them to demonstrations at different model positions. Experimental results on 8 text classification tasks show that our approach outperforms conventional ICL by a large margin. Our code are publicly available at https:github.com/Zhe-Young/WICL.


title: The Connection Algebra of Reductive Homogeneous Spaces

abstract: The connection algebra of a reductive homogeneous space is called an invariant connection algebra. This is an algebra that is closely related to Lie-Yamaguti algebras. In this article we describe this structure and provide a basis for the free invariant connection algebra. We also give a summary of the less complicated connection algebras that occur when the torsion or the curvature is vanishing.


title: Low Complexity Algorithms for Mission Completion Time Minimization in UAV-Based ISAC Systems

abstract: The inherent support of sixth-generation (6G) systems enabling integrated sensing and communications (ISAC) paradigm greatly enhances the application area of intelligent transportation systems (ITS). One of the mission-critical applications enabled by these systems is disaster management, where ISAC functionality may not only provide localization but also provide users with supplementary information such as escape routes, time to rescue, etc. In this paper, by considering a large area with several locations of interest, we formulate and solve the optimization problem of delivering task parameters of the ISAC system by optimizing the UAV speed and the order of visits to the locations of interest such that the mission time is minimized. The formulated problem is a mixed integer non-linear program which is quite challenging to solve. To reduce the complexity of the solution algorithms, we propose two circular trajectory designs. The first algorithm finds the optimal UAV velocity and radius of the circular trajectories. The second algorithm finds the optimal connecting points for joining the individual circular trajectories. Our numerical results reveal that, with practical simulation parameters, the first algorithm provides a time saving of at least $20\%$, while the second algorithm cuts down the total completion time by at least $7$ times.


title: GePSAn: Generative Procedure Step Anticipation in Cooking Videos

abstract: We study the problem of future step anticipation in procedural videos. Given a video of an ongoing procedural activity, we predict a plausible next procedure step described in rich natural language. While most previous work focus on the problem of data scarcity in procedural video datasets, another core challenge of future anticipation is how to account for multiple plausible future realizations in natural settings. This problem has been largely overlooked in previous work. To address this challenge, we frame future step prediction as modelling the distribution of all possible candidates for the next step. Specifically, we design a generative model that takes a series of video clips as input, and generates multiple plausible and diverse candidates (in natural language) for the next step. Following previous work, we side-step the video annotation scarcity by pretraining our model on a large text-based corpus of procedural activities, and then transfer the model to the video domain. Our experiments, both in textual and video domains, show that our model captures diversity in the next step prediction and generates multiple plausible future predictions. Moreover, our model establishes new state-of-the-art results on YouCookII, where it outperforms existing baselines on the next step anticipation. Finally, we also show that our model can successfully transfer from text to the video domain zero-shot, ie, without fine-tuning or adaptation, and produces good-quality future step predictions from video.