title: On the values of commutativity degree of Lie algebras

abstract: In this paper, the possible values of commutativity degree of Lie algebras are determined. Also, we define the asymptotic commutativity degree of Lie algebras and obtain the asymptotic commutativity degree for some of them. Moreover, we prove the existence of a family of Lie algebras such that the asymptotic commutativity degree is equal to 1\qk for all q greater than 2 and a positive integer k.


title: D-NPC: Dynamic Neural Point Clouds for Non-Rigid View Synthesis from Monocular Video

abstract: Dynamic reconstruction and spatiotemporal novel-view synthesis of non-rigidly deforming scenes recently gained increased attention. While existing work achieves impressive quality and performance on multi-view or teleporting camera setups, most methods fail to efficiently and faithfully recover motion and appearance from casual monocular captures. This paper contributes to the field by introducing a new method for dynamic novel view synthesis from monocular video, such as casual smartphone captures. Our approach represents the scene as a $\textit{dynamic neural point cloud}$, an implicit time-conditioned point distribution that encodes local geometry and appearance in separate hash-encoded neural feature grids for static and dynamic regions. By sampling a discrete point cloud from our model, we can efficiently render high-quality novel views using a fast differentiable rasterizer and neural rendering network. Similar to recent work, we leverage advances in neural scene analysis by incorporating data-driven priors like monocular depth estimation and object segmentation to resolve motion and depth ambiguities originating from the monocular captures. In addition to guiding the optimization process, we show that these priors can be exploited to explicitly initialize our scene representation to drastically improve optimization speed and final image quality. As evidenced by our experimental evaluation, our dynamic point cloud model not only enables fast optimization and real-time frame rates for interactive applications, but also achieves competitive image quality on monocular benchmark sequences. Our project page is available at https://moritzkappel.github.io/projects/dnpc.


title: Localizing Events in Videos with Multimodal Queries

abstract: Video understanding is a pivotal task in the digital era, yet the dynamic and multievent nature of videos makes them labor-intensive and computationally demanding to process. Thus, localizing a specific event given a semantic query has gained importance in both user-oriented applications like video search and academic research into video foundation models. A significant limitation in current research is that semantic queries are typically in natural language that depicts the semantics of the target event. This setting overlooks the potential for multimodal semantic queries composed of images and texts. To address this gap, we introduce a new benchmark, ICQ, for localizing events in videos with multimodal queries, along with a new evaluation dataset ICQ-Highlight. Our new benchmark aims to evaluate how well models can localize an event given a multimodal semantic query that consists of a reference image, which depicts the event, and a refinement text to adjust the images' semantics. To systematically benchmark model performance, we include 4 styles of reference images and 5 types of refinement texts, allowing us to explore model performance across different domains. We propose 3 adaptation methods that tailor existing models to our new setting and evaluate 10 SOTA models, ranging from specialized to large-scale foundation models. We believe this benchmark is an initial step toward investigating multimodal queries in video event localization.


title: Two classes of level Eulerian posets

abstract: We present two classes of level Eulerian posets. Both classes contain intervals of rank k+1 whose cd-index is the sum over all cd-monomials w of degree k and the coefficient of the monomial w is r to the power of the number of d's in w. We also show that the order complexes of every interval in the first class are homeomorphic to spheres.


title: $SU(2)$ principal chiral model with tensor renormalization group on a cubic lattice

abstract: We study the continuous phase transition and thermodynamic observables in the three-dimensional Euclidean $SU(2)$ principal chiral field model with the triad tensor renormalization group (tTRG) and the anisotropic tensor renormalization group (ATRG) methods. Using these methods, we find results that are consistent with previous Monte Carlo estimates and the predicted renormalization group scaling of the magnetization close to criticality. These results bring us one step closer to studying finite-density QCD in four dimensions using tensor network methods.


title: Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation

abstract: Audio-Visual Speech Recognition (AVSR) uses lip-based video to improve performance in noise. Since videos are harder to obtain than audio, the video training data of AVSR models is usually limited to a few thousand hours. In contrast, speech models such as Whisper are trained with hundreds of thousands of hours of data, and thus learn a better speech-to-text decoder. The huge training data difference motivates us to adapt Whisper to handle video inputs. Inspired by Flamingo which injects visual features into language models, we propose Whisper-Flamingo which integrates visual features into the Whisper speech recognition and translation model with gated cross attention. Our audio-visual Whisper-Flamingo outperforms audio-only Whisper on English speech recognition and En-X translation for 6 languages in noisy conditions. Moreover, Whisper-Flamingo is a versatile model and conducts all of these tasks using one set of parameters, while prior methods are trained separately on each language.


title: On the Evaluation of Speech Foundation Models for Spoken Language Understanding

abstract: The Spoken Language Understanding Evaluation (SLUE) suite of benchmark tasks was recently introduced to address the need for open resources and benchmarking of complex spoken language understanding (SLU) tasks, including both classification and sequence generation tasks, on natural speech. The benchmark has demonstrated preliminary success in using pre-trained speech foundation models (SFM) for these SLU tasks. However, the community still lacks a fine-grained understanding of the comparative utility of different SFMs. Inspired by this, we ask: which SFMs offer the most benefits for these complex SLU tasks, and what is the most effective approach for incorporating these SFMs? To answer this, we perform an extensive evaluation of multiple supervised and self-supervised SFMs using several evaluation protocols: (i) frozen SFMs with a lightweight prediction head, (ii) frozen SFMs with a complex prediction head, and (iii) fine-tuned SFMs with a lightweight prediction head. Although the supervised SFMs are pre-trained on much more speech recognition data (with labels), they do not always outperform self-supervised SFMs; the latter tend to perform at least as well as, and sometimes better than, supervised SFMs, especially on the sequence generation tasks in SLUE. While there is no universally optimal way of incorporating SFMs, the complex prediction head gives the best performance for most tasks, although it increases the inference time. We also introduce an open-source toolkit and performance leaderboard, SLUE-PERB, for these tasks and modeling strategies.


title: Is it Truly Necessary for Bicycle Power Meters to Rapidly Sample Angular Velocity?

abstract: Bicycle Power Meters have become ubiquitous in professional and amateur cycling. These devices claim high levels of accuracy, and this accuracy is indeed essential if they are to serve their purpose as reliable training aids and indicators of improvements in fitness. Power is generally obtained via the independent estimation of torque and angular velocity. Designs vary in the way in which they estimate angular velocity. Some power meters estimate angular velocity many times a second, whereas other power meters compute an average value for each pedal stroke. The aim of this paper is to investigate whether it is necessary to rapidly sample angular velocity in order to obtain accurate power values under conditions of dynamic equilibrium. Countering previous research on the topic, this paper finds that average angular velocity alone is usually sufficient for the purposes of computing power, although there may be certain exceptional circumstances where consideration of harmonics may appreciably improve fidelity.


title: Enhancing Question Answering on Charts Through Effective Pre-training Tasks

abstract: To completely understand a document, the use of textual information is not enough. Understanding visual cues, such as layouts and charts, is also required. While the current state-of-the-art approaches for document understanding (both OCR-based and OCR-free) work well, a thorough analysis of their capabilities and limitations has not yet been performed. Therefore, in this work, we addresses the limitation of current VisualQA models when applied to charts and plots. To investigate shortcomings of the state-of-the-art models, we conduct a comprehensive behavioral analysis, using ChartQA as a case study. Our findings indicate that existing models particularly underperform in answering questions related to the chart's structural and visual context, as well as numerical information. To address these issues, we propose three simple pre-training tasks that enforce the existing model in terms of both structural-visual knowledge, as well as its understanding of numerical questions. We evaluate our pre-trained model (called MatCha-v2) on three chart datasets - both extractive and abstractive question datasets - and observe that it achieves an average improvement of 1.7% over the baseline model.


title: Discovering influential text using convolutional neural networks

abstract: Experimental methods for estimating the impacts of text on human evaluation have been widely used in the social sciences. However, researchers in experimental settings are usually limited to testing a small number of pre-specified text treatments. While efforts to mine unstructured texts for features that causally affect outcomes have been ongoing in recent years, these models have primarily focused on the topics or specific words of text, which may not always be the mechanism of the effect. We connect these efforts with NLP interpretability techniques and present a method for flexibly discovering clusters of similar text phrases that are predictive of human reactions to texts using convolutional neural networks. When used in an experimental setting, this method can identify text treatments and their effects under certain assumptions. We apply the method to two datasets. The first enables direct validation of the model's ability to detect phrases known to cause the outcome. The second demonstrates its ability to flexibly discover text treatments with varying textual structures. In both cases, the model learns a greater variety of text treatments compared to benchmark methods, and these text features quantitatively meet or exceed the ability of benchmark methods to predict the outcome.


title: Biomarker based Cancer Classification using an Ensemble with Pre-trained Models

abstract: Certain cancer types, namely pancreatic cancer is difficult to detect at an early stage; sparking the importance of discovering the causal relationship between biomarkers and cancer to identify cancer efficiently. By allowing for the detection and monitoring of specific biomarkers through a non-invasive method, liquid biopsies enhance the precision and efficacy of medical interventions, advocating the move towards personalized healthcare. Several machine learning algorithms such as Random Forest, SVM are utilized for classification, yet causing inefficiency due to the need for conducting hyperparameter tuning. We leverage a meta-trained Hyperfast model for classifying cancer, accomplishing the highest AUC of 0.9929 and simultaneously achieving robustness especially on highly imbalanced datasets compared to other ML algorithms in several binary classification tasks (e.g. breast invasive carcinoma; BRCA vs. non-BRCA). We also propose a novel ensemble model combining pre-trained Hyperfast model, XGBoost, and LightGBM for multi-class classification tasks, achieving an incremental increase in accuracy (0.9464) while merely using 500 PCA features; distinguishable from previous studies where they used more than 2,000 features for similar results.


title: Stability of persistent currents in superfluid fermionic rings

abstract: We investigate the stability of persistent currents in superfluid fermionic gases confined to a ring geometry. Our studies, conducted at zero temperature using time-dependent density functional theory, cover interaction regimes from strong (unitary Fermi gas) to weak (Bardeen-Cooper-Schrieffer regime) couplings. Stability is tested with respect to the presence of an external defect within the ring. The dissipation mechanism related to vortex generation is present in all interaction regimes. Interestingly, while the corresponding critical winding number is found to be independent of the regime, the flow energy dissipation and its origin strongly depend on it. Vortex emission is accompanied by Cooper pair breaking, which occurs even beyond the vortex core in the weakly interacting regime. The pair-breaking mechanism prevents the imprinting of a persistent current with a winding number above a threshold, which decreases as we approach the BCS regime. Our study reveals the existence of two types of critical winding numbers above which the currents cease to be persistent in Fermi superfluids: one related to the proliferation of quantum vortices and the other with the onset of the pair-breaking mechanism.


title: Enhancing Security in Millimeter Wave SWIPT Networks

abstract: Millimeter wave (mmWave) communication encounters a major issue of extremely high power consumption. To address this problem, the simultaneous wireless information and power transfer (SWIPT) could be a promising technology. The mmWave frequencies are more appropriate for the SWIPT comparing to current low-frequency wireless transmissions, since mmWave base stations (BSs) can pack with large antenna arrays to achieve significant array gains and high-speed short-distance transmissions. Unfortunately, the implementation of SWIPT in the wireless communication may lead to an expanded defencelessness against the eavesdropping due to high transmission power and data spillage. It is conventionally believed that narrow beam offers inherent information-theoretic security against the eavesdropping, because only the eavesdroppers, which rely on the line-of-sight path between the legitimate transmitter and receiver, can receive strong enough signals. However, some mmWave experiments have shown that even by using highly directional mmWaves, the reflection signals caused by objects in the environment can be beneficial to the eavesdroppers. This paper studies the security performance in general mmWave SWIPT networks, and investigates the probability of successful eavesdropping under different attack models. Analytical expressions of eavesdropping success probability (ESP) of both independent and colluding eavesdroppers are derived by incorporating the random reflection paths in the environment. Theoretical analysis and simulation results reveal the effects of some key parameters on the ESP, such as the time switching strategy in SWIPT, densities of mmWave BSs, and carriers frequencies, etc. Based on the numerical and simulation results, some design suggestions of mmWave SWIPT are provided to defend against eavesdropping attacks and achieve secure communication in practice.


title: Over-parameterization and Adversarial Robustness in Neural Networks: An Overview and Empirical Analysis

abstract: Thanks to their extensive capacity, over-parameterized neural networks exhibit superior predictive capabilities and generalization. However, having a large parameter space is considered one of the main suspects of the neural networks' vulnerability to adversarial example -- input samples crafted ad-hoc to induce a desired misclassification. Relevant literature has claimed contradictory remarks in support of and against the robustness of over-parameterized networks. These contradictory findings might be due to the failure of the attack employed to evaluate the networks' robustness. Previous research has demonstrated that depending on the considered model, the algorithm employed to generate adversarial examples may not function properly, leading to overestimating the model's robustness. In this work, we empirically study the robustness of over-parameterized networks against adversarial examples. However, unlike the previous works, we also evaluate the considered attack's reliability to support the results' veracity. Our results show that over-parameterized networks are robust against adversarial attacks as opposed to their under-parameterized counterparts.


title: Exploring the Correlation between Human and Machine Evaluation of Simultaneous Speech Translation

abstract: Assessing the performance of interpreting services is a complex task, given the nuanced nature of spoken language translation, the strategies that interpreters apply, and the diverse expectations of users. The complexity of this task become even more pronounced when automated evaluation methods are applied. This is particularly true because interpreted texts exhibit less linearity between the source and target languages due to the strategies employed by the interpreter. This study aims to assess the reliability of automatic metrics in evaluating simultaneous interpretations by analyzing their correlation with human evaluations. We focus on a particular feature of interpretation quality, namely translation accuracy or faithfulness. As a benchmark we use human assessments performed by language experts, and evaluate how well sentence embeddings and Large Language Models correlate with them. We quantify semantic similarity between the source and translated texts without relying on a reference translation. The results suggest GPT models, particularly GPT-3.5 with direct prompting, demonstrate the strongest correlation with human judgment in terms of semantic similarity between source and target texts, even when evaluating short textual segments. Additionally, the study reveals that the size of the context window has a notable impact on this correlation.


title: Mild-to-wild plasticity of Earth's upper mantle

abstract: The flow of Earth's upper mantle has long been considered to occur by slow and near-continuous creep. Such behaviour is observed in classical high-temperature deformation experiments and is a fundamental component of geodynamic models. However, the latest generation of high-resolution experiments, capable of sensing temporal heterogeneities in rates of dislocation motion, have revealed that materials ranging from metals to ice exhibit a spectrum of behaviours termed mild-to-wild plasticity. It remains unknown whether olivine, the most abundant mineral in Earth's upper mantle, always exhibits mild continuous flow or can exhibit intermittent wild fluctuations in plastic strain rate. Here, we demonstrate that olivine exhibits measurable wildness, even under conditions at which its behaviour is predicted to be relatively mild. During nanoindentation experiments conducted at room temperature, continuous plastic flow is punctuated by intermittent bursts of displacement with log-normally distrubuted magnitudes, indicating avalanches of correlated dislocation motion that account for approximately 8 +/- 6% of the plastic strain. Remarkably, the framework of mild-to-wild plasticity predicts that wildness should increase with depth in the Earth, with flow of the asthenospheric upper mantle occurring almost entirely by wild fluctuations of deformation at the grain scale. The recognition of intermittent plasticity in geological materials provides new constraints for microphysical models of dislocation-mediated flow and raises questions about the mehcanisms of transient instabilities in otherwise ductile regimes, such as deep earthquakes and slow-slip events.


title: BiKC: Keypose-Conditioned Consistency Policy for Bimanual Robotic Manipulation

abstract: Bimanual manipulation tasks typically involve multiple stages which require efficient interactions between two arms, posing step-wise and stage-wise challenges for imitation learning systems. Specifically, failure and delay of one step will broadcast through time, hinder success and efficiency of each sub-stage task, and thereby overall task performance. Although recent works have made strides in addressing certain challenges, few approaches explicitly consider the multi-stage nature of bimanual tasks while simultaneously emphasizing the importance of inference speed. In this paper, we introduce a novel keypose-conditioned consistency policy tailored for bimanual manipulation. It is a hierarchical imitation learning framework that consists of a high-level keypose predictor and a low-level trajectory generator. The predicted keyposes provide guidance for trajectory generation and also mark the completion of one sub-stage task. The trajectory generator is designed as a consistency model trained from scratch without distillation, which generates action sequences conditioning on current observations and predicted keyposes with fast inference speed. Simulated and real-world experimental results demonstrate that the proposed approach surpasses baseline methods in terms of success rate and operational efficiency.


title: Insulating Half-Heusler TmPdSb with Unusual Band Order and Metallic Surface States

abstract: We present theoretical and experimental results exploring a half-Heusler compound TmPdSb with unusual band order and metallic surface states. Typically, the half-Heusler systems exhibit topological features in a semimetallic state, and trivial ones in an insulating state. Topological properties of the most of half-Heusler systems are related to the band inversion around the Fermi level, similar to this observed in CdTe/HgTe systems. In the case of TmPdSb we observed the gapped electronic band structure with ``band inversion'' in the conductance band, while the slab-like system realized metallic surface states. The bulk insulating nature of the compound was corroborated by means of electrical transport measurements. The experimental data revealed several features due to the presence of metallic surface states, such as linear magnetoresistance and weak-antilocalization effect, characterized by enhanced coherence length and a very large number of surface conductive channels. Our findings reveal new features of the rare-earth half-Heusler.


title: Calculation of the chiral Lagrangian coefficients with light vector mesons

abstract: We calculate the coefficients in the effective chiral Lagrangian from QCD, which includes pseudo-scalar mesons and vector mesons (with hidden symmetry), up to O(p4). This encompasses both the normal and anomalous parts. Our work builds on a previous study that derived the chiral Lagrangian from first principles of QCD, where the low-energy coefficients are defined in terms of specific Green's functions in QCD. This research extends our earlier efforts that focused on calculating the low-energy coefficients of the chiral Lagrangian for pure pseudo-scalar mesons. This marks the first calculation of chiral Lagrangian coefficients for vector mesons from QCD, particularly for the important parameters a and g, which are typically considered inputs in existing literature. Notably, the regularization method used previously is inadequate for this broader scope. We find that cut-off regularization yields reasonable results for both pseudo-scalar mesons and vector mesons, though it has certain limitations. Finally, we demonstrate that our method aligns with the Weinberg sum rules.


title: The Spectrometer Development of CosmoCube, Lunar Orbiting Satellite to Detect 21-cm Hydrogen Signal from Cosmic Dark Ages

abstract: The cosmic Dark Ages represent a pivotal epoch in the evolution of the Universe, marked by the emergence of the first cosmic structures under the influence of dark matter. The 21-cm hydrogen line, emanating from the hyperfine transition of neutral hydrogen, serves as a critical probe into this era. We describe the development and implementation of the spectrometer for CosmoCube, a novel lunar orbiting CubeSat designed to detect the redshifted 21-cm signal within the redshift range of 13 to 150. Our instrumentation utilizes a Xilinx RFSoC, which integrates both Analog-to-Digital Converters (ADCs) and Digital-to-Analog Converters (DACs), tailored for the spectrometer component of the radiometer. This system is characterized by a 4096 FFT length at 62.5 kHz steps using a Polyphase Filter Bank (PFB), achieving an average Effective Number of Bits (ENOB) of 11.5 bits throughout the frequency of interest, from 10 MHz to 100 MHz. The spectrometer design is further refined through loopback tests involving both DAC and ADC of the RFSoC, with DAC outputs varying between high (+1 dBm) and low (-3 dBm) power modes to characterize system performance. The power consumption was optimized to 5.45 W using three ADCs and one DAC for the radiometer. Additionally, the stability of the ADC noise floor was investigated in a thermal chamber with environmental temperatures ranging from 5{\deg}C to 40{\deg}C. A consistent noise floor of approximately -152.5 dBFS/Hz was measured, with a variation of $\pm$0.2 dB, ensuring robust performance under varying thermal conditions.


title: A search for leptonic photon Z_l at all three CLIC energy stages by using artificial neural networks (ANN)

abstract: In this work, the possible dynamics of the massive leptonic photon \(Z_{l}\) are reconsidered via the process \(e^{+}e^{-} \ rightarrow \mu^{+}\mu^{-}\) at Compact Linear Collider (CLIC) with updated center of mass energies (\(380\ GeV,\ 1500\ GeV\ and\ 3000\ GeV\)). We show that the new generation colliders as CLIC can observe massive leptophilic vector boson Z_l with mass up to the center of mass energy, provided that leptonic coupling constant is \(g_{l} \geq 10^{- 3}\). In this study, we also estimated the cross-sections by artificial neural networks using the theoretical results we obtained for CLIC. According to the results obtained, it was seen that these predictions could be made through machine learning.


title: ECGMamba: Towards Efficient ECG Classification with BiSSM

abstract: Electrocardiogram (ECG) signal analysis represents a pivotal technique in the diagnosis of cardiovascular diseases. Although transformer-based models have made significant progress in ECG classification, they exhibit inefficiencies in the inference phase. The issue is primarily attributable to the secondary computational complexity of Transformer's self-attention mechanism. particularly when processing lengthy sequences. To address this issue, we propose a novel model, ECGMamba, which employs a bidirectional state-space model (BiSSM) to enhance classification efficiency. ECGMamba is based on the innovative Mamba-based block, which incorporates a range of time series modeling techniques to enhance performance while maintaining the efficiency of inference. The experimental results on two publicly available ECG datasets demonstrate that ECGMamba effectively balances the effectiveness and efficiency of classification, achieving competitive performance. This study not only contributes to the body of knowledge in the field of ECG classification but also provides a new research path for efficient and accurate ECG signal analysis. This is of guiding significance for the development of diagnostic models for cardiovascular diseases.


title: Know the Unknown: An Uncertainty-Sensitive Method for LLM Instruction Tuning

abstract: Large language models (LLMs) have demonstrated remarkable capabilities across various tasks but still face challenges such as hallucinations. One potential reason for hallucinations is the lack of relevant knowledge or context. Thus, a promising solution to mitigate this issue involves instructing LLMs to respond with "I do not know" when a question falls outside their knowledge domain or the provided context. However, in this work, we observed that LLMs struggle to admit their lack of knowledge, primarily due to existing instruction datasets designed to encourage specific answers. To improve large language models' capability to recognize the boundaries of their knowledge, we propose a novel approach called uncertainty-sensitive tuning. This method involves two-stage training designed for uncertainty recognition and prompt-sensitive activation. In the first stage, we guide the LLM to reject unknown questions. In the second stage, we recover the decreased performance in QA tasks by incorporating designed causal instructions. By leveraging this method, we aim to enhance the model's ability to identify areas of uncertainty. The experimental results demonstrate that our proposed uncertainty-sensitive tuning method significantly improves the performance of the Llama2-chat-7B model. Specifically, it achieves a substantial 34.7% improvement in handling questions involving knowledge gaps compared to the original model. Moreover, our approach outperforms GPT-4, exhibiting a 9.4% increase in overall performance. We open-source the model and code on GitHub.


title: SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding

abstract: Remote Sensing Large Multi-Modal Models (RSLMMs) are developing rapidly and showcase significant capabilities in remote sensing imagery (RSI) comprehension. However, due to the limitations of existing datasets, RSLMMs have shortcomings in understanding the rich semantic relations among objects in complex remote sensing scenes. To unlock RSLMMs' complex comprehension ability, we propose a large-scale instruction tuning dataset FIT-RS, containing 1,800,851 instruction samples. FIT-RS covers common interpretation tasks and innovatively introduces several complex comprehension tasks of escalating difficulty, ranging from relation reasoning to image-level scene graph generation. Based on FIT-RS, we build the FIT-RSFG benchmark. Furthermore, we establish a new benchmark to evaluate the fine-grained relation comprehension capabilities of LMMs, named FIT-RSRC. Based on combined instruction data, we propose SkySenseGPT, which achieves outstanding performance on both public datasets and FIT-RSFG, surpassing existing RSLMMs. We hope the FIT-RS dataset can enhance the relation comprehension capability of RSLMMs and provide a large-scale fine-grained data source for the remote sensing community. The dataset will be available at https://github.com/Luo-Z13/SkySenseGPT


title: Requirements are All You Need: From Requirements to Code with LLMs

abstract: The pervasive use of textual formats in the documentation of software requirements presents a great opportunity for applying large language models (LLMs) to software engineering tasks. High-quality software requirements not only enhance the manual software development process but also position organizations to fully harness the potential of the emerging LLMs technology. This paper introduces a tailored LLM for automating the generation of code snippets from well-structured requirements documents. This LLM is augmented with knowledge, heuristics, and instructions that are pertinent to the software development process, requirements analysis, object-oriented design, and test-driven development, effectively emulating the expertise of a seasoned software engineer. We introduce a "Progressive Prompting" method that allows software engineers to engage with this LLM in a stepwise manner. Through this approach, the LLM incrementally tackles software development tasks by interpreting the provided requirements to extract functional requirements, using these to create object-oriented models, and subsequently generating unit tests and code based on the object-oriented designs. We demonstrate the LLM's proficiency in comprehending intricate user requirements and producing robust design and code solutions through a case study focused on the development of a web project. This study underscores the potential of integrating LLMs into the software development workflow to significantly enhance both efficiency and quality. The tailored LLM is available at https://chat.openai.com/g/g-bahoiKzkB-software-engineer-gpt.


title: A high-flux cold-atom source utilising a grating atom chip

abstract: Bose-Einstein condensates (BECs) have been proposed for many applications in atom interferometry, as their coherence over long evolution times promises unprecedented sensitivity. To date, BECs can be efficiently created in devices using atom chips, but these are still complex and place high demands on size, weight and power. To further simplify these setups, we equipped an atom chip with a nano-structured diffraction-grating to derive all beams for the magneto-optical trap (MOT) from a single laser beam. Moreover, using a 2D$^+$-MOT as an atomic source and a beam with uniform intensity for the grating illumination, we capture $1\times10^9$ atoms in one second, cool them to $14\,\mu$K, and demonstrate magnetic trapping using the atom chip. This is a major step towards the simplification of portable BEC devices for quantum sensing on earth and in space.


title: The Black Hole Explorer: Back End Electronics

abstract: This paper describes specification and early design of back end signal processing subsystems for the Black Hole Explorer (BHEX) Very Long Baseline Interferometry (VLBI) space telescope. The "back end" consists of two subsystems. First, the block downconverter (BDC) is a heterodyne system that performs a frequency translation of the analog signal from IF to baseband and amplifies and filters it for digitization. Second, the digital back end (DBE) samples the analog signal with an analog-to-digital converters (ADC) and digitally processes the data stream formatting them to the VLBI "VDIF" standard and converting to Ethernet packets for 100 gigabit-per-second (Gb/s) Ethernet transport to the optical downlink system. Both the BDC and the DBE for BHEX support eight channels of 4.096 GHz bandwidth each, for a total processed bandwidth of 32.768 GHz. The BHEX back end benefits from mature terrestrial back end heritage, described in some detail. The BHEX back end itself is in the early stages of design, with requirements, interface specifications, and component trade studies well advanced. The aim is to build a prototype using terrestrial grade parts which are available in functionally identical space grade equivalents, and to use this prototype to advance the back end Technology Readiness Level (TRL) preparing for a Small Explorer (SMEX) proposal in 2025.


title: A moduli space of stable sheaves on a cubic threefold

abstract: In this paper, we prove that the moduli space $\overline{M}_{X}(\nu)$ of $H$-Gieseker semistable sheaves on a smooth cubic threefold $X$ with Chern character $\nu=(4,-H,-\frac{5}{6}H^{2},\frac{1}{6}H^{3})$ is non-empty, smooth and irreducible of dimension $8$.


title: A wireless method to obtain the longitudinal beam impedance from scattering parameters

abstract: The coaxial wire method is a common and appreciated technique to assess the beam coupling impedance of an accelerator element from scattering parameters. Nevertheless, the results obtained from wire measurements could be inaccurate due to the presence of the stretched conductive wire that artificially creates the conditions for the propagation of a Transverse ElectroMagnetic (TEM) mode. The aim of this work is to establish a solid technique to obtain the beam coupling impedance from electromagnetic simulations, without modifications of the device under test. In this framework, we identified a new relation to get the longitudinal resistive wall beam coupling impedance of a circular chamber directly from the scattering parameters and demonstrated that it reduces to the exact theoretical expression. Furthermore, a possible generalization of the method to arbitrary cross-section chamber geometries has been studied and validated with numerical simulations.


title: Equidistribution of Kloosterman sums over function fields

abstract: We prove the Sato--Tate distribution of Kloosterman sums over function fields with explicit error terms, when the places vary in arithmetic progressions or short intervals. A joint Sato--Tate distribution of two ``different" exponential sums is also proved.


title: Annotation Cost-Efficient Active Learning for Deep Metric Learning Driven Remote Sensing Image Retrieval

abstract: Deep metric learning (DML) has shown to be very effective for content-based image retrieval (CBIR) in remote sensing (RS). Most of DML methods for CBIR rely on many annotated images to accurately learn model parameters of deep neural networks. However, gathering many image annotations is time consuming and costly. To address this, we propose an annotation cost-efficient active learning (ANNEAL) method specifically designed for DML driven CBIR in RS. ANNEAL aims to create a small but informative training set made up of similar and dissimilar image pairs to be utilized for learning a deep metric space. The informativeness of the image pairs is assessed combining uncertainty and diversity criteria. To assess the uncertainty of image pairs, we introduce two algorithms: 1) metric-guided uncertainty estimation (MGUE); and 2) binary classifier guided uncertainty estimation (BCGUE). MGUE automatically estimates a threshold value that acts as a "boundary" between similar and dissimilar image pairs based on the distances in the metric space. The closer the similarity between image pairs to the estimated threshold value the higher their uncertainty. BCGUE estimates the uncertainty of the image pairs based on the confidence of the classifier in assigning the correct similarity label. The diversity criterion is assessed through a clustering-based strategy. ANNEAL selects the most informative image pairs by combining either MGUE or BCGUE with clustering-based strategy. The selected image pairs are sent to expert annotators to be labeled as similar or dissimilar. This way of annotating images significantly reduces the annotation cost compared to the cost of annotating images with LULC labels. Experimental results carried out on two RS benchmark datasets demonstrate the effectiveness of our method. The code of the proposed method will be publicly available upon the acceptance of the paper.


title: Precipitation Nowcasting Using Physics Informed Discriminator Generative Models

abstract: Nowcasting leverages real-time atmospheric conditions to forecast weather over short periods. State-of-the-art models, including PySTEPS, encounter difficulties in accurately forecasting extreme weather events because of their unpredictable distribution patterns. In this study, we design a physics-informed neural network to perform precipitation nowcasting using the precipitation and meteorological data from the Royal Netherlands Meteorological Institute (KNMI). This model draws inspiration from the novel Physics-Informed Discriminator GAN (PID-GAN) formulation, directly integrating physics-based supervision within the adversarial learning framework. The proposed model adopts a GAN structure, featuring a Vector Quantization Generative Adversarial Network (VQ-GAN) and a Transformer as the generator, with a temporal discriminator serving as the discriminator. Our findings demonstrate that the PID-GAN model outperforms numerical and SOTA deep generative models in terms of precipitation nowcasting downstream metrics.


title: SoK: Analysis of Software Supply Chain Security by Establishing Secure Design Properties

abstract: This paper systematizes knowledge about secure software supply chain patterns. It identifies four stages of a software supply chain attack and proposes three security properties crucial for a secured supply chain: transparency, validity, and separation. The paper describes current security approaches and maps them to the proposed security properties, including research ideas and case studies of supply chains in practice. It discusses the strengths and weaknesses of current approaches relative to known attacks and details the various security frameworks put out to ensure the security of the software supply chain. Finally, the paper highlights potential gaps in actor and operation-centered supply chain security techniques


title: Efficient Mixed Integer Linear Programming Approaches to Dynamic Path Restoration

abstract: We consider the problem of single link failure in an elastic optical network, (also known as flex-grid WDM network). The task is to reroute optical connections that go through the broken link using free capacity of other links of the network. Nowadays, dynamic restoration gains popularity, in which the possiblity of rerouting is only inspected after a link failure is detected. Since the problem of recovery is NP-hard, heuristic algorithms are used to either find such routes, or suggest that the routes do not exist. In order to understand the quality of these heuristics, often mixed integer linear programming is used to obtain exact positive and negative answers. We present a detailed such model that checks whether restoration is possible without the use of additional regenerators. This means, that the new light paths need to satisfy a length constraint. As preprossing we apply a trimming procedure that takes advantage of this length constraint, and significantly speeds up the evaluation of these models. Our model is more general, and besides solving the problem of link restoration, also solves the full problem of wavelength and spectrum assignment.


title: GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors

abstract: Achieving high-resolution novel view synthesis (HRNVS) from low-resolution input views is a challenging task due to the lack of high-resolution data. Previous methods optimize high-resolution Neural Radiance Field (NeRF) from low-resolution input views but suffer from slow rendering speed. In this work, we base our method on 3D Gaussian Splatting (3DGS) due to its capability of producing high-quality images at a faster rendering speed. To alleviate the shortage of data for higher-resolution synthesis, we propose to leverage off-the-shelf 2D diffusion priors by distilling the 2D knowledge into 3D with Score Distillation Sampling (SDS). Nevertheless, applying SDS directly to Gaussian-based 3D super-resolution leads to undesirable and redundant 3D Gaussian primitives, due to the randomness brought by generative priors. To mitigate this issue, we introduce two simple yet effective techniques to reduce stochastic disturbances introduced by SDS. Specifically, we 1) shrink the range of diffusion timestep in SDS with an annealing strategy; 2) randomly discard redundant Gaussian primitives during densification. Extensive experiments have demonstrated that our proposed GaussainSR can attain high-quality results for HRNVS with only low-resolution inputs on both synthetic and real-world datasets. Project page: https://chchnii.github.io/GaussianSR/


title: The Kinetic Fokker-Planck equation in a domain: Ultracontractivity, hypocoercivity and long-time asymptotic behavior

abstract: We consider the Kinetic Fokker-Planck (FKP) equation in a domain with Maxwell reflection condition on the boundary. We establish the ultracontractivity of the associated semigroup and the hypocoercivity of the associated operator. We deduce the convergence with constructive rate of the solution to the KFP equation towards the stationary state with same mass as the initial datum.


title: Matrix units in the simple components of rational group algebras

abstract: For the rational group algebra $\mathbb{Q}G$ of a finite group $G$, we provide an effective method to compute a complete set of matrix units and, in particular, primitive orthogonal idempotents in a simple component of $\mathbb{Q}G$, which is realized by a generalized strongly monomial character and has a prime Schur index. We also provide some classes of groups $G$ where this method can be successfully applied. The application of the method developed is also illustrated with detailed computations.


title: Task-aligned Part-aware Panoptic Segmentation through Joint Object-Part Representations

abstract: Part-aware panoptic segmentation (PPS) requires (a) that each foreground object and background region in an image is segmented and classified, and (b) that all parts within foreground objects are segmented, classified and linked to their parent object. Existing methods approach PPS by separately conducting object-level and part-level segmentation. However, their part-level predictions are not linked to individual parent objects. Therefore, their learning objective is not aligned with the PPS task objective, which harms the PPS performance. To solve this, and make more accurate PPS predictions, we propose Task-Aligned Part-aware Panoptic Segmentation (TAPPS). This method uses a set of shared queries to jointly predict (a) object-level segments, and (b) the part-level segments within those same objects. As a result, TAPPS learns to predict part-level segments that are linked to individual parent objects, aligning the learning objective with the task objective, and allowing TAPPS to leverage joint object-part representations. With experiments, we show that TAPPS considerably outperforms methods that predict objects and parts separately, and achieves new state-of-the-art PPS results.


title: Shelf-Supervised Multi-Modal Pre-Training for 3D Object Detection

abstract: State-of-the-art 3D object detectors are often trained on massive labeled datasets. However, annotating 3D bounding boxes remains prohibitively expensive and time-consuming, particularly for LiDAR. Instead, recent works demonstrate that self-supervised pre-training with unlabeled data can improve detection accuracy with limited labels. Contemporary methods adapt best-practices for self-supervised learning from the image domain to point clouds (such as contrastive learning). However, publicly available 3D datasets are considerably smaller and less diverse than those used for image-based self-supervised learning, limiting their effectiveness. We do note, however, that such data is naturally collected in a multimodal fashion, often paired with images. Rather than pre-training with only self-supervised objectives, we argue that it is better to bootstrap point cloud representations using image-based foundation models trained on internet-scale image data. Specifically, we propose a shelf-supervised approach (e.g. supervised with off-the-shelf image foundation models) for generating zero-shot 3D bounding boxes from paired RGB and LiDAR data. Pre-training 3D detectors with such pseudo-labels yields significantly better semi-supervised detection accuracy than prior self-supervised pretext tasks. Importantly, we show that image-based shelf-supervision is helpful for training LiDAR-only and multi-modal (RGB + LiDAR) detectors. We demonstrate the effectiveness of our approach on nuScenes and WOD, significantly improving over prior work in limited data settings.


title: Spatial coherence of synchrotron radiation degraded by grating monochromators

abstract: In this work, we present a physical and theoretical description of the significant degradation of X-ray spatial coherence properties due to the use of grating monochromators at synchrotron facilities. We present a comprehensive study of the effects of spatial coherence degradation as a function of grating parameters under different focusing and propagation conditions. The focus is on the effect of spatial coherence degradation caused by the grating alone, starting from a fully coherent incident photon beam generated by a filament source. The mathematical description and theoretical analysis of the spatial coherence degradation is presented in the framework of statistical optics.


title: Trustworthy Artificial Intelligence in the Context of Metrology

abstract: We review research at the National Physical Laboratory (NPL) in the area of trustworthy artificial intelligence (TAI), and more specifically trustworthy machine learning (TML), in the context of metrology, the science of measurement. We describe three broad themes of TAI: technical, socio-technical and social, which play key roles in ensuring that the developed models are trustworthy and can be relied upon to make responsible decisions. From a metrology perspective we emphasise uncertainty quantification (UQ), and its importance within the framework of TAI to enhance transparency and trust in the outputs of AI systems. We then discuss three research areas within TAI that we are working on at NPL, and examine the certification of AI systems in terms of adherence to the characteristics of TAI.


title: SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages

abstract: Southeast Asia (SEA) is a region rich in linguistic diversity and cultural variety, with over 1,300 indigenous languages and a population of 671 million people. However, prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA, compromising the quality of AI models for SEA languages. Evaluating models for SEA languages is challenging due to the scarcity of high-quality datasets, compounded by the dominance of English training data, raising concerns about potential cultural misrepresentation. To address these challenges, we introduce SEACrowd, a collaborative initiative that consolidates a comprehensive resource hub that fills the resource gap by providing standardized corpora in nearly 1,000 SEA languages across three modalities. Through our SEACrowd benchmarks, we assess the quality of AI models on 36 indigenous languages across 13 tasks, offering valuable insights into the current AI landscape in SEA. Furthermore, we propose strategies to facilitate greater AI advancements, maximizing potential utility and resource equity for the future of AI in SEA.


title: Modified Risk Formulation for Improving the Prediction of Knee Osteoarthritis Progression

abstract: Current methods for predicting osteoarthritis (OA) outcomes do not incorporate disease specific prior knowledge to improve the outcome prediction models. We developed a novel approach that effectively uses consecutive imaging studies to improve OA outcome predictions by incorporating an OA severity constraint. This constraint ensures that the risk of OA for a knee should either increase or remain the same over time. DL models were trained to predict TKR within multiple time periods (1 year, 2 years, and 4 years) using knee radiographs and MRI scans. Models with and without the risk constraint were evaluated using the area under the receiver operator curve (AUROC) and the area under the precision recall curve (AUPRC) analysis. The novel RiskFORM2 method, leveraging a dual model risk constraint architecture, demonstrated superior performance, yielding an AUROC of 0.87 and AUPRC of 0.47 for 1 year TKR prediction on the OAI radiograph test set, a marked improvement over the 0.79 AUROC and 0.34 AUPRC of the baseline approach. The performance advantage extended to longer followup periods, with RiskFORM2 maintaining a high AUROC of 0.86 and AUPRC of 0.75 in predicting TKR within 4 years. Additionally, when generalizing to the external MOST radiograph test set, RiskFORM2 generalized better with an AUROC of 0.77 and AUPRC of 0.25 for 1 year predictions, which was higher than the 0.71 AUROC and 0.19 AUPRC of the baseline approach. In the MRI test sets, similar patterns emerged, with RiskFORM2 outperforming the baseline approach consistently. However, RiskFORM1 exhibited the highest AUROC of 0.86 and AUPRC of 0.72 for 4 year predictions on the OAI set.


title: A Weak Entanglement Approximation for Nuclear Structure

abstract: The interacting shell model, a configuration-interaction method, is a venerable approach to low-lying nuclear structure; but it is hampered by the exponential growth of the basis dimension as one increases the single-particle space and/or the number of active particles. Recent, quantum-information-inspired work has demonstrated that the proton and neutron sectors of a nuclear wave function are weakly entangled. Furthermore the entanglement is smaller for nuclides away from N = Z, such as heavy, neutron-rich nuclides. Here we implement a weak entanglement approximation to bipartite configuration-interaction wave functions, approximating low-lying levels through coupling a relatively small number of many-proton and many-neutron states. This truncation scheme, which we put in context to other past approaches, reduces the basis dimension by many orders of magnitude while preserving essential features of nuclear spectra.


title: Data Ethics in the Era of Healthcare Artificial Intelligence in Africa: An Ubuntu Philosophy Perspective

abstract: Data are essential in developing healthcare artificial intelligence (AI) systems. However, patient data collection, access, and use raise ethical concerns, including informed consent, data bias, data protection and privacy, data ownership, and benefit sharing. Various ethical frameworks have been proposed to ensure the ethical use of healthcare data and AI, however, these frameworks often align with Western cultural values, social norms, and institutional contexts emphasizing individual autonomy and well-being. Ethical guidelines must reflect political and cultural settings to account for cultural diversity, inclusivity, and historical factors such as colonialism. Thus, this paper discusses healthcare data ethics in the AI era in Africa from the Ubuntu philosophy perspective. It focuses on the contrast between individualistic and communitarian approaches to data ethics. The proposed framework could inform stakeholders, including AI developers, healthcare providers, the public, and policy-makers about healthcare data ethical usage in AI in Africa.


title: $B_{n-1}$-orbits on the flag variety and the Bruhat graph for $S_{n}\times S_{n}$

abstract: Let $G=G_{n}=GL(n)$ be the $n\times n$ complex general linear group and embed $G_{n-1}=GL(n-1)$ in the top left hand corner of $G$. The standard Borel subgroup of upper triangular matrices $B_{n-1}$ of $G_{n-1}$ acts on the flag variety of $G$ with finitely many orbits. In this paper, we show that each $B_{n-1}$-orbit is the intersection of orbits of two Borel subgroups of $G$ acting on the flag variety of $G$. This allows us to give a new combinatorial description of the $B_{n-1}$-orbits by associating to each orbit a pair of Weyl group elements. The closure relations for the $B_{n-1}$-orbits can then be understood in terms of the Bruhat order on the Weyl group, and the Richardson-Springer monoid action on the orbits can be understood in terms of the classical monoid action of the Weyl group on itself. This approach makes the closure relation more transparent than in earlier work of Magyar and the monoid action significantly more computable than in our earlier papers, and also allows us to obtain new information about the orbits including a simple formula for the dimension of an orbit.


title: Improving neutrino energy estimation of charged-current interaction events with recurrent neural networks in MicroBooNE

abstract: We present a deep learning-based method for estimating the neutrino energy of charged-current neutrino-argon interactions. We employ a recurrent neural network (RNN) architecture for neutrino energy estimation in the MicroBooNE experiment, utilizing liquid argon time projection chamber (LArTPC) detector technology. Traditional energy estimation approaches in LArTPCs, which largely rely on reconstructing and summing visible energies, often experience sizable biases and resolution smearing because of the complex nature of neutrino interactions and the detector response. The estimation of neutrino energy can be improved after considering the kinematics information of reconstructed final-state particles. Utilizing kinematic information of reconstructed particles, the deep learning-based approach shows improved resolution and reduced bias for the muon neutrino Monte Carlo simulation sample compared to the traditional approach. In order to address the common concern about the effectiveness of this method on experimental data, the RNN-based energy estimator is further examined and validated with dedicated data-simulation consistency tests using MicroBooNE data. We also assess its potential impact on a neutrino oscillation study after accounting for all statistical and systematic uncertainties and show that it enhances physics sensitivity. This method has good potential to improve the performance of other physics analyses.


title: Technical Report: A Totally Asynchronous Nesterov's Accelerated Gradient Method for Convex Optimization

abstract: We present a totally asynchronous algorithm for convex optimization that is based on a novel generalization of Nesterov's accelerated gradient method. This algorithm is developed for fast convergence under "total asynchrony," i.e., allowing arbitrarily long delays between agents' computations and communications without assuming any form of delay bound. These conditions may arise, for example, due to jamming by adversaries. Our framework is block-based, in the sense that each agent is only responsible for computing updates to (and communicating the values of) a small subset of the network-level decision variables. In our main result, we present bounds on the algorithm's parameters that guarantee linear convergence to an optimizer. Then, we quantify the relationship between (i) the total number of computations and communications executed by the agents and (ii) the agents' collective distance to an optimum. Numerical simulations show that this algorithm requires 28% fewer iterations than the heavy ball algorithm and 61% fewer iterations than gradient descent under total asynchrony.


title: MapVision: CVPR 2024 Autonomous Grand Challenge Mapless Driving Tech Report

abstract: Autonomous driving without high-definition (HD) maps demands a higher level of active scene understanding. In this competition, the organizers provided the multi-perspective camera images and standard-definition (SD) maps to explore the boundaries of scene reasoning capabilities. We found that most existing algorithms construct Bird's Eye View (BEV) features from these multi-perspective images and use multi-task heads to delineate road centerlines, boundary lines, pedestrian crossings, and other areas. However, these algorithms perform poorly at the far end of roads and struggle when the primary subject in the image is occluded. Therefore, in this competition, we not only used multi-perspective images as input but also incorporated SD maps to address this issue. We employed map encoder pre-training to enhance the network's geometric encoding capabilities and utilized YOLOX to improve traffic element detection precision. Additionally, for area detection, we innovatively introduced LDTR and auxiliary tasks to achieve higher precision. As a result, our final OLUS score is 0.58.


title: Training-free Camera Control for Video Generation

abstract: We propose a training-free and robust solution to offer camera movement control for off-the-shelf video diffusion models. Unlike previous work, our method does not require any supervised finetuning on camera-annotated datasets or self-supervised training via data augmentation. Instead, it can be plugged and played with most pretrained video diffusion models and generate camera controllable videos with a single image or text prompt as input. The inspiration of our work comes from the layout prior that intermediate latents hold towards generated results, thus rearranging noisy pixels in them will make output content reallocated as well. As camera move could also be seen as a kind of pixel rearrangement caused by perspective change, videos could be reorganized following specific camera motion if their noisy latents change accordingly. Established on this, we propose our method CamTrol, which enables robust camera control for video diffusion models. It is achieved by a two-stage process. First, we model image layout rearrangement through explicit camera movement in 3D point cloud space. Second, we generate videos with camera motion using layout prior of noisy latents formed by a series of rearranged images. Extensive experiments have demonstrated the robustness our method holds in controlling camera motion of generated videos. Furthermore, we show that our method can produce impressive results in generating 3D rotation videos with dynamic content. Project page at https://lifedecoder.github.io/CamTrol/.


title: Exploration by Learning Diverse Skills through Successor State Measures

abstract: The ability to perform different skills can encourage agents to explore. In this work, we aim to construct a set of diverse skills which uniformly cover the state space. We propose a formalization of this search for diverse skills, building on a previous definition based on the mutual information between states and skills. We consider the distribution of states reached by a policy conditioned on each skill and leverage the successor state measure to maximize the difference between these skill distributions. We call this approach LEADS: Learning Diverse Skills through Successor States. We demonstrate our approach on a set of maze navigation and robotic control tasks which show that our method is capable of constructing a diverse set of skills which exhaustively cover the state space without relying on reward or exploration bonuses. Our findings demonstrate that this new formalization promotes more robust and efficient exploration by combining mutual information maximization and exploration bonuses.


title: SmartRSD: An Intelligent Multimodal Approach to Real-Time Road Surface Detection for Safe Driving

abstract: Precise and prompt identification of road surface conditions enables vehicles to adjust their actions, like changing speed or using specific traction control techniques, to lower the chance of accidents and potential danger to drivers and pedestrians. However, most of the existing methods for detecting road surfaces solely rely on visual data, which may be insufficient in certain situations, such as when the roads are covered by debris, in low light conditions, or in the presence of fog. Therefore, we introduce a multimodal approach for the automated detection of road surface conditions by integrating audio and images. The robustness of the proposed method is tested on a diverse dataset collected under various environmental conditions and road surface types. Through extensive evaluation, we demonstrate the effectiveness and reliability of our multimodal approach in accurately identifying road surface conditions in real-time scenarios. Our findings highlight the potential of integrating auditory and visual cues for enhancing road safety and minimizing accident risks


title: Investigating the Role of Quantum Entanglement in Heavy Ion Collisions through Elliptic Flow

abstract: This paper investigates the relationship between initial spatial anisotropy and final state momentum anisotropy in heavy ion collisions through the analysis of elliptic flow ($\nu_2$) as a function of transverse momentum ($p_T$). Building upon previous studies on thermalization in heavy ion collisions using transverse momentum distributions, we extend the analysis to the $p_T$ dependence of $\nu_2$ in Pb-Pb and Xe-Xe collisions. By employing a two-component model to extract the thermal and hard scattering contributions to the elliptic flow, we aim to gain further insights into the role of quantum entanglement in the rapid thermalization and collective behavior of the quark-gluon plasma (QGP).


title: The Devil is in the Neurons: Interpreting and Mitigating Social Biases in Pre-trained Language Models

abstract: Pre-trained Language models (PLMs) have been acknowledged to contain harmful information, such as social biases, which may cause negative social impacts or even bring catastrophic results in application. Previous works on this problem mainly focused on using black-box methods such as probing to detect and quantify social biases in PLMs by observing model outputs. As a result, previous debiasing methods mainly finetune or even pre-train language models on newly constructed anti-stereotypical datasets, which are high-cost. In this work, we try to unveil the mystery of social bias inside language models by introducing the concept of {\sc Social Bias Neurons}. Specifically, we propose {\sc Integrated Gap Gradients (IG$^2$)} to accurately pinpoint units (i.e., neurons) in a language model that can be attributed to undesirable behavior, such as social bias. By formalizing undesirable behavior as a distributional property of language, we employ sentiment-bearing prompts to elicit classes of sensitive words (demographics) correlated with such sentiments. Our IG$^2$ thus attributes the uneven distribution for different demographics to specific Social Bias Neurons, which track the trail of unwanted behavior inside PLM units to achieve interoperability. Moreover, derived from our interpretable technique, {\sc Bias Neuron Suppression (BNS)} is further proposed to mitigate social biases. By studying BERT, RoBERTa, and their attributable differences from debiased FairBERTa, IG$^2$ allows us to locate and suppress identified neurons, and further mitigate undesired behaviors. As measured by prior metrics from StereoSet, our model achieves a higher degree of fairness while maintaining language modeling ability with low cost.


title: Linear Contextual Bandits with Hybrid Payoff: Revisited

abstract: We study the Linear Contextual Bandit problem in the hybrid reward setting. In this setting every arm's reward model contains arm specific parameters in addition to parameters shared across the reward models of all the arms. We can reduce this setting to two closely related settings (a) Shared - no arm specific parameters, and (b) Disjoint - only arm specific parameters, enabling the application of two popular state of the art algorithms - $\texttt{LinUCB}$ and $\texttt{DisLinUCB}$ (Algorithm 1 in (Li et al. 2010)). When the arm features are stochastic and satisfy a popular diversity condition, we provide new regret analyses for both algorithms, significantly improving on the known regret guarantees of these algorithms. Our novel analysis critically exploits the hybrid reward structure and the diversity condition. Moreover, we introduce a new algorithm $\texttt{HyLinUCB}$ that crucially modifies $\texttt{LinUCB}$ (using a new exploration coefficient) to account for sparsity in the hybrid setting. Under the same diversity assumptions, we prove that $\texttt{HyLinUCB}$ also incurs only $O(\sqrt{T})$ regret for $T$ rounds. We perform extensive experiments on synthetic and real-world datasets demonstrating strong empirical performance of $\texttt{HyLinUCB}$.For number of arm specific parameters much larger than the number of shared parameters, we observe that $\texttt{DisLinUCB}$ incurs the lowest regret. In this case, regret of $\texttt{HyLinUCB}$ is the second best and extremely competitive to $\texttt{DisLinUCB}$. In all other situations, including our real-world dataset, $\texttt{HyLinUCB}$ has significantly lower regret than $\texttt{LinUCB}$, $\texttt{DisLinUCB}$ and other SOTA baselines we considered. We also empirically observe that the regret of $\texttt{HyLinUCB}$ grows much slower with the number of arms compared to baselines, making it suitable even for very large action spaces.


title: Carbon Monoxide Cooling in Radiative Transfer Modeling of Supernovae

abstract: Carbon monoxide (CO) emission has been observed in a number of core-collapse supernovae (SNe) and is known to be an important coolant at late times. We have implemented a chemical reaction network in the radiative-transfer code CMFGEN to investigate the formation of CO and its impact on SN ejecta. We calculate two 1D SN models with and without CO: a BSG explosion model at one nebular epoch and a full time sequence (50 to 300 days) for a RSG explosion. In both models, CO forms at nebular times in the dense, inner regions at velocities $<2000 \mathrm{km/s}$ where line emission from CO can dominate the cooling and reduce the local temperature by as much as a factor of two, weakening emission lines and causing the optical light curve to fade faster. That energy is instead emitted in CO bands, primarily the fundamental band at $\sim 4.5\mathrm{\mu m}$, which accounts for up to 20% of the total luminosity at late times. However, the non-monotonic nature of the CO cooling function can cause numerical difficulties and introduce multiple temperature solutions. This issue is compounded by the sensitivity of the CO abundance to a few reaction rates, many of which have large uncertainties or disparate values across literature sources. Our results also suggest that, in many SNe, CO level populations are far from their LTE values. Unfortunately, accurate collisional data, necessary to compute NLTE populations, are limited to a few transitions.


title: Evaluation of Large Language Models: STEM education and Gender Stereotypes

abstract: Large Language Models (LLMs) have an increasing impact on our lives with use cases such as chatbots, study support, coding support, ideation, writing assistance, and more. Previous studies have revealed linguistic biases in pronouns used to describe professions or adjectives used to describe men vs women. These issues have to some degree been addressed in updated LLM versions, at least to pass existing tests. However, biases may still be present in the models, and repeated use of gender stereotypical language may reinforce the underlying assumptions and are therefore important to examine further. This paper investigates gender biases in LLMs in relation to educational choices through an open-ended, true to user-case experimental design and a quantitative analysis. We investigate the biases in the context of four different cultures, languages, and educational systems (English/US/UK, Danish/DK, Catalan/ES, and Hindi/IN) for ages ranging from 10 to 16 years, corresponding to important educational transition points in the different countries. We find that there are significant and large differences in the ratio of STEM to non-STEM suggested education paths provided by chatGPT when using typical girl vs boy names to prompt lists of suggested things to become. There are generally fewer STEM suggestions in the Danish, Spanish, and Indian context compared to the English. We also find subtle differences in the suggested professions, which we categorise and report.


title: Bifurcations of periodic orbits in the 3D secular planetary 3-Body problem: an approach through an integrable Hamiltonian system

abstract: We analyze, through a geometric description, the sequence of bifurcations of periodic orbits in a Hamiltonian model derived from the normalization of the secular 3D planetary three body problem. Stemming from the results in (Mastroianni & Efthymiopoulos 2023) we analyze the phase space of the corresponding integrable approximation. In particular, we propose a normal form leading to an integrable Hamiltonian whose sequence of bifurcations is qualitatively the same as that in the complete system. Using as representation of the phase space the 3D-sphere in the Hopf variables space, we geometrically analyze phase-space dynamics through the sequence of bifurcations leading to the appearance of fixed points of the secular Hamiltonian flow, i.e., periodic orbits in the complete system. Moreover, through a semi-analytical method, we find the critical values of the second integral giving rise to pitchfork and saddle-node bifurcations characterising the dynamics.


title: Non-Unitary Quantum Many-Body Dynamics using the Faber Polynomial Method

abstract: Efficient numerical methods are still lacking to probe the unconventional dynamics of quantum many-body systems under non-unitary evolution. In this work, we use Faber polynomials to numerically simulate both the dynamics of non-Hermitian systems and the quantum jumps unravelling of the Lindblad dynamics. We apply the method to the non-interacting and interacting Hatano-Nelson models evolving from two different setups: i) a N\'eel state, and ii) a domain wall. In the first case, we study how interactions preserve the initial magnetic order against the skin effect. In the second example, we present numerical evidence of the existence of an effective hydrodynamic description for the domain-wall melting problem in the non-interacting limit. Additionally, we investigate both the conditional and unconditional dynamics of the quantum jump unravelling in two quantum spin chains, which exhibit either the non-Hermitian or the Liouvillian skin effect. This numerical method inherently generalises the well-established method based on Chebyshev polynomials to accommodate non-Hermitian scenarios.


title: Rationalizability, Cost-Rationalizability, and Afriat's Efficiency Index

abstract: This note explains the equivalence between approximate rationalizability and approximate cost-rationalizability within the context of consumer demand. In connection with these results, we interpret Afriat's (1973) critical cost-efficiency index (CCEI) as a measure of approximate rationalizability through cost inefficiency, in the sense that an agent is spending more money than is required to achieve her utility targets.


title: Compressed Sensor Caching and Collaborative Sparse Data Recovery with Anchor Alignment

abstract: This work examines the compressed sensor caching problem in wireless sensor networks and devises efficient distributed sparse data recovery algorithms to enable collaboration among multiple caches. In this problem, each cache is only allowed to access measurements from a small subset of sensors within its vicinity to reduce both cache size and data acquisition overhead. To enable reliable data recovery with limited access to measurements, we propose a distributed sparse data recovery method, called the collaborative sparse recovery by anchor alignment (CoSR-AA) algorithm, where collaboration among caches is enabled by aligning their locally recovered data at a few anchor nodes. The proposed algorithm is based on the consensus alternating direction method of multipliers (ADMM) algorithm but with message exchange that is reduced by considering the proposed anchor alignment strategy. Then, by the deep unfolding of the ADMM iterations, we further propose the Deep CoSR-AA algorithm that can be used to significantly reduce the number of iterations. We obtain a graph neural network architecture where message exchange is done more efficiently by an embedded autoencoder. Simulations are provided to demonstrate the effectiveness of the proposed collaborative recovery algorithms in terms of the improved reconstruction quality and the reduced communication overhead due to anchor alignment.


title: Black string solutions in Lifshitz spacetime

abstract: In this paper we study black string solutions considering the Lifshitz anisotropic scaling. We have shown that a new class of asymptotically Lifshitz solutions can be generated by an Einstein-Maxwell-Dilaton theory with a cosmological constant. In the limit where we recover conformal scale invariance, we retrieve the usual black string solution. Furthermore, we demonstrated that to incorporate the effects of electric charge in the black string, at least two independent gauge fields coupled to the dilaton field are necessary. The charged black string solution exhibits new horizons that depend on the potential in Lifshitz exponent $z$. The stability of these new solutions is investigated through the thermodynamic analysis of the charged black string. The temperature, entropy, and heat capacity indicate that these modified black strings are thermodynamically stable.


title: YOLOv1 to YOLOv10: A comprehensive review of YOLO variants and their application in the agricultural domain

abstract: This survey investigates the transformative potential of various YOLO variants, from YOLOv1 to the state-of-the-art YOLOv10, in the context of agricultural advancements. The primary objective is to elucidate how these cutting-edge object detection models can re-energise and optimize diverse aspects of agriculture, ranging from crop monitoring to livestock management. It aims to achieve key objectives, including the identification of contemporary challenges in agriculture, a detailed assessment of YOLO's incremental advancements, and an exploration of its specific applications in agriculture. This is one of the first surveys to include the latest YOLOv10, offering a fresh perspective on its implications for precision farming and sustainable agricultural practices in the era of Artificial Intelligence and automation. Further, the survey undertakes a critical analysis of YOLO's performance, synthesizes existing research, and projects future trends. By scrutinizing the unique capabilities packed in YOLO variants and their real-world applications, this survey provides valuable insights into the evolving relationship between YOLO variants and agriculture. The findings contribute towards a nuanced understanding of the potential for precision farming and sustainable agricultural practices, marking a significant step forward in the integration of advanced object detection technologies within the agricultural sector.


title: A micromechanical study of heat treatment induced hardening in {\alpha}-brass

abstract: The mechanisms that govern a previously unexplained hardening effect of a single phase Cu-30wt%Zn {\alpha}-brass after heating have been investigated. After cold-work, the alloy possesses an increased yield strength and hardening rate only when heat treated to temperatures close to 220{^\circ}C, and is otherwise softer. Crystallographic texture and microstructure, explored using electron backscatter diffraction (EBSD), describe the deformation heterogeneity including twin development, as a function of heat treatment. When heated, an increased area fraction of deformation twins is observed, with dimensions reaching a critical size that maximises the resistance to dislocation slip in the parent grains. The effect is shown to dominate over other alloy characteristics including short range order, giving serrated yielding during tensile testing which is mostly eliminated after heating. In-situ X-ray diffraction during tensile testing corroborates these findings; dislocation-related line broadening and lattice strain development between as worked and heated {\alpha}-brass is directly related to the interaction between the dislocations and the population of deformation twins. The experiments unambiguously disprove that other thermally-induced microstructure features contribute to thermal hardening. Specifically, the presence of recrystallised grains or second phases do not play a role. As these heat treatments match annealing conditions subjected to {\alpha}-brass during deformation-related manufacturing processes, the results here are considered critical to understand, predict and exploit, where appropriate, any beneficial process-induced structural behaviour.


title: The Rise and Fall(?) of Software Engineering

abstract: Over the last ten years, the realm of Artificial Intelligence (AI) has experienced an explosion of revolutionary breakthroughs, transforming what seemed like a far-off dream into a reality that is now deeply embedded in our everyday lives. AI's widespread impact is revolutionizing virtually all aspects of human life, and software engineering (SE) is no exception. As we explore this changing landscape, we are faced with questions about what the future holds for SE and how AI will reshape the roles, duties, and methodologies within the field. The introduction of these groundbreaking technologies highlights the inevitable shift towards a new paradigm, suggesting a future where AI's capabilities may redefine the boundaries of SE, potentially even more than human input. In this paper, we aim at outlining the key elements that, based on our expertise, are vital for the smooth integration of AI into SE, all while preserving the intrinsic human creativity that has been the driving force behind the field. First, we provide a brief description of SE and AI evolution. Afterward, we delve into the intricate interplay between AI-driven automation and human innovation, exploring how these two components can work together to advance SE practices to new methods and standards.


title: Decoherence effects on local quantum Fisher information and quantum coherence in a spin-1/2 Ising-XYZ chain

abstract: This research explores the effects of decoherence on local quantum Fisher information and quantum coherence dynamics in a spin-1/2 Ising-XYZ chain model with independent reservoirs at zero temperature. Contrasting these effects with those in the spin-1/2 Heisenberg XYZ model reveals intricate interactions among quantum coherence, entanglement, and environmental decoherence in spin systems. Analysis of coherence dynamics highlights differences between the original and hybrid models, showcasing increased entanglement due to Ising interactions alongside reduced coherence from environmental redistribution. The local quantum Fisher information proves more resilient than coherence in specific scenarios, emphasizing decoherence is varying impacts on quantum correlations. This research underscores the complexity of quantum coherence dynamics and the crucial role of environmental factors in shaping quantum correlations, providing insights into entanglement and coherence behavior under environmental influences and guiding future studies in quantum information processing and correlation dynamics.


title: The Black Hole Explorer: Instrument System Overview

abstract: The Black Hole Explorer (BHEX) is a space very-long-baseline interferometry (VLBI) mission concept that is currently under development. BHEX will study supermassive black holes at unprecedented resolution, isolating the signature of the "photon ring" - light that has orbited the black hole before escaping - to probe physics at the edge of the observable universe. It will also measure black hole spins, study the energy extraction and acceleration mechanisms for black hole jets, and characterize the black hole mass distribution. BHEX achieves high angular resolution by joining with ground-based millimeter-wavelength VLBI arrays, extending the size, and therefore improving the angular resolution of the earthbound telescopes. Here we discuss the science instrument concept for BHEX. The science instrument for BHEX is a dual-band, coherent receiver system for 80-320 GHz, coupled to a 3.5-meter antenna. BHEX receiver front end will observe simultaneously with dual polarizations in two bands, one sampling 80-106 GHz and one sampling 240-320 GHz. An ultra-stable quartz oscillator provides the master frequency reference and ensures coherence for tens of seconds. To achieve the required sensitivity, the front end will instantaneously receive 32 GHz of frequency bandwidth, which will be digitized to 64 Gbits/sec of incompressible raw data. These data will be buffered and transmitted to the ground via laser data link, for correlation with data recorded simultaneously at radio telescopes on the ground. We describe the challenges associated with the instrument concept and the solutions that have been incorporated into the baseline design.


title: Improving rule mining via embedding-based link prediction

abstract: Rule mining on knowledge graphs allows for explainable link prediction. Contrarily, embedding-based methods for link prediction are well known for their generalization capabilities, but their predictions are not interpretable. Several approaches combining the two families have been proposed in recent years. The majority of the resulting hybrid approaches are usually trained within a unified learning framework, which often leads to convergence issues due to the complexity of the learning task. In this work, we propose a new way to combine the two families of approaches. Specifically, we enrich a given knowledge graph by means of its pre-trained entity and relation embeddings before applying rule mining systems on the enriched knowledge graph. To validate our approach, we conduct extensive experiments on seven benchmark datasets. An analysis of the results generated by our approach suggests that we discover new valuable rules on the enriched graphs. We provide an open source implementation of our approach as well as pretrained models and datasets at https://github.com/Jean-KOUAGOU/EnhancedRuleLearning


title: Function Reconstruction Using Rank-1 Lattices and Lower Sets

abstract: Our study focuses on constructing optimal rank-1 lattices that enable exact integration and reconstruction of functions in the Chebyshev space, based on finite index sets. We introduce novel theoretical lower bounds on the minimum number of integrands needed for reconstruction, show equivalence between different plans for reconstruction under certain conditions and propose an innovative algorithm for generating the optimal generator vector of rank-1 lattices. By leveraging the inherent structure of the set of interpolators, our approach ensures admissibility conditions through exhaustive search and verification, outperforming existing methods in terms of computation time and memory usage. Numerical experiments validate the efficiency and practical applicability of our algorithm.


title: Multimodal Radiomics Model for Predicting Gold Nanoparticles Accumulation in Mouse Tumors

abstract: Background: Nanoparticles can accumulate in solid tumors, serving as diagnostic or therapeutic agents for cancer. Clinical translation is challenging due to low accumulation in tumors and heterogeneity between tumor types and individuals. Tools to identify this heterogeneity and predict nanoparticle accumulation are needed. Advanced imaging techniques combined with radiomics and AI may offer a solution. Methods: 183 mice were used to create seven subcutaneous tumor models, with three sizes (15nm, 40nm, 70nm) of gold nanoparticles injected via the tail vein. Accumulation was measured using ICP-OES. Data were divided into training and test sets (7:3). Tumors were categorized into high and low uptake groups based on the median value of the training set. Before injection, multimodal imaging data (CT, B-mode ultrasound, SWE, CEUS) were acquired, and radiomics features extracted. LASSO and RFE algorithms built a radiomics signature. This, along with tumor type and mean values from CT and SWE, constructed the best model using SVM. For each tumor in the test set, the radiomics signature predicted gold nanoparticle uptake. Model performance was evaluated by AUC. Results: Significant variability in gold nanoparticle accumulation was observed among tumors (P < 0.001). The median accumulation in the training set was 3.37% ID/g. Nanoparticle size was not a main determinant of uptake (P > 0.05). The composite model based on radiomics signature outperformed the basic model in both training (AUC 0.93 vs. 0.68) and testing (0.78 vs. 0.61) datasets. Conclusion: The composite model identifies tumor heterogeneity and predicts high uptake of gold nanoparticles, improving patient stratification and supporting nanomedicine's clinical application.


title: From Concrete to Abstract in Indian Mathematics

abstract: Despite the extensive amount of scholarly work done on Indian mathematics in the last 200 years, the conditions under which it originated and evolved is still not clear. Often, one reads the ancient texts with the present concepts and methods in mind. The fact of absence of script over a long stretch of Indian history in ancient times also gets overlooked in such readings. The purpose of this article is to explore the journey of mathematics by examining what the ancient texts tell us about the nature of mathematics in their times. What one finds from the investigation of arithmetic, geometry and algebra is that while it was concrete and context bound, rooted in solving practical problems in ancient times, Indian mathematics transitioned to context free, abstract stage with the advent of algebra supported by writing.


title: A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints

abstract: Interest in bilevel optimization has grown in recent years, partially due to its applications to tackle challenging machine-learning problems. Several exciting recent works have been centered around developing efficient gradient-based algorithms that can solve bilevel optimization problems with provable guarantees. However, the existing literature mainly focuses on bilevel problems either without constraints, or featuring only simple constraints that do not couple variables across the upper and lower levels, excluding a range of complex applications. Our paper studies this challenging but less explored scenario and develops a (fully) first-order algorithm, which we term BLOCC, to tackle BiLevel Optimization problems with Coupled Constraints. We establish rigorous convergence theory for the proposed algorithm and demonstrate its effectiveness on two well-known real-world applications - hyperparameter selection in support vector machine (SVM) and infrastructure planning in transportation networks using the real data from the city of Seville.


title: BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack

abstract: In recent years, the input context sizes of large language models (LLMs) have increased dramatically. However, existing evaluation methods have not kept pace, failing to comprehensively assess the efficiency of models in handling long contexts. To bridge this gap, we introduce the BABILong benchmark, designed to test language models' ability to reason across facts distributed in extremely long documents. BABILong includes a diverse set of 20 reasoning tasks, including fact chaining, simple induction, deduction, counting, and handling lists/sets. These tasks are challenging on their own, and even more demanding when the required facts are scattered across long natural text. Our evaluations show that popular LLMs effectively utilize only 10-20\% of the context and their performance declines sharply with increased reasoning complexity. Among alternatives to in-context reasoning, Retrieval-Augmented Generation methods achieve a modest 60\% accuracy on single-fact question answering, independent of context length. Among context extension methods, the highest performance is demonstrated by recurrent memory transformers, enabling the processing of lengths up to 11 million tokens. The BABILong benchmark is extendable to any length to support the evaluation of new upcoming models with increased capabilities, and we provide splits up to 1 million token lengths.


title: Subhalos are Distributed Anisotropically About Their Hosts

abstract: We investigate the distributions of subhalos about their hosts in two suites of zoom-in N-body simulations of halo growth -- one suite focused on Milky Way Mass halos ($\sim 10^{12} \mathrm{M}_{\odot}$) and another focused on cluster ($\sim 10^{15} \mathrm{M}_{\odot}$) halos in the Symphony simulation suite. We find, in agreement with previous work on this subject, that subhalos are distributed anisotropically about their host halos. In particular, the positions of subhalos lie preferentially near the major axes of their host halos, possibly implying that satellite galaxies will exhibit a similar alignment. Furthermore, we show that in two-dimensional projection subhalos are more likely to be observed near the halo center (where the central galaxy presumably resides) when the host halo is projected nearly along its major axis. This projection effect is significant. Within a projected radius of $5\%$ of the virial radius of the host halo, the fraction of mass in subhalos is $\sim 44\%$ larger for Milky Way mass halos and as much as $\sim 145\%$ larger for cluster halos when projected along the major axis as compared to the average from a random projection. This result has consequences for many applications including the interpretation of gravitational lenses. Finally, we find that the orbital angular momentum vector of subhalos is aligned with the angular momentum vector of their host halo, indicating that a significant component of a halo's angular momentum may be carried in its subhalos. This has consequences for galaxy formation models which use host halo angular momentum as a proxy for galaxy momentum.


title: Las actividades de laboratorio en F\'isica: un cambio en la estructura a favor del conocimiento cient\'ifico

abstract: In this article we argue how the use of structured laboratory guides are pedagogically inadequate for meaningful learning. Subsequently, an approach to laboratory activities in accordance with scientific work and the constructivist vision of learning is described, exemplifying how this approach can be applied to restructure a usual laboratory practice.


title: Joint Speaker Features Learning for Audio-visual Multichannel Speech Separation and Recognition

abstract: This paper proposes joint speaker feature learning methods for zero-shot adaptation of audio-visual multichannel speech separation and recognition systems. xVector and ECAPA-TDNN speaker encoders are connected using purpose-built fusion blocks and tightly integrated with the complete system training. Experiments conducted on LRS3-TED data simulated multichannel overlapped speech suggest that joint speaker feature learning consistently improves speech separation and recognition performance over the baselines without joint speaker feature estimation. Further analyses reveal performance improvements are strongly correlated with increased inter-speaker discrimination measured using cosine similarity. The best-performing joint speaker feature learning adapted system outperformed the baseline fine-tuned WavLM model by statistically significant WER reductions of 21.6% and 25.3% absolute (67.5% and 83.5% relative) on Dev and Test sets after incorporating WavLM features and video modality.


title: Asymptotic scaling laws for periodic turbulent boundary layers and their numerical simulation up to Re_theta = 8300

abstract: We provide a rigorous analysis of the self-similar solution of the temporal turbulent boundary layer, recently proposed in [2], in which a body force is used to maintain a statistically steady turbulent boundary layer with periodic boundary conditions in the streamwise direction. We derive explicit expressions for the forcing amplitudes which can maintain such flows, and identify those which can hold either the displacement thickness or the momentum thickness equal to unity. This opens the door to the first main result of the paper, which is to prove upper bounds on skin friction for the temporal turbulent boundary layer. We use the Constantin-Doering-Hopf bounding method to show, rigorously, that the skin friction coefficient for periodic turbulent boundary layer flows is bounded above by a uniform constant which decreases asymptotically with Reynolds number. This asymptotic behaviour is within a logarithmic correction of well-known empirical scaling laws for skin friction. This gives the first evidence, applicable at asymptotically high Reynolds numbers, to suggest that the self-similar solution of the temporal turbulent boundary layer exhibits statistical similarities with canonical, spatially evolving, boundary layers. Furthermore, we show how the identified forcing formula implies an alternative, and simpler, numerical implementation of periodic boundary layer flows. We give a detailed numerical study of this scheme presenting direct numerical simulations up to Re_theta = 2000 and implicit large-eddy simulations up to Re_theta = 8300, and show that these results compare well with data from canonical spatially evolving boundary layers at equivalent Reynolds numbers.


title: Automated Design of Linear Bounding Functions for Sigmoidal Nonlinearities in Neural Networks

abstract: The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification techniques offer provable guarantees for all robustness queries but struggle to scale beyond small neural networks. To overcome this computational intractability, incomplete verification methods often rely on convex relaxation to over-approximate the nonlinearities in neural networks. Progress in tighter approximations has been achieved for piecewise linear functions. However, robustness verification of neural networks for general activation functions (e.g., Sigmoid, Tanh) remains under-explored and poses new challenges. Typically, these networks are verified using convex relaxation techniques, which involve computing linear upper and lower bounds of the nonlinear activation functions. In this work, we propose a novel parameter search method to improve the quality of these linear approximations. Specifically, we show that using a simple search method, carefully adapted to the given verification problem through state-of-the-art algorithm configuration techniques, improves the average global lower bound by 25% on average over the current state of the art on several commonly used local robustness verification benchmarks.


title: On Twisted Spacetimes: a new class of Galilean cosmological models

abstract: Within the generalized Newton-Cartan theory, Galilean Twisted spacetimes are introduced as dual models of the well-known relativistic twisted spacetimes. As a natural generalization, torqued vector fields in Galilean spacetimes are defined, showing that the local structure of a Galilean spacetime admitting a timelike torqued vector field is given by a Twisted spacetime. In addition, several results assuring the global splitting as Twisted spacetime are obtained. On the other hand, completeness of free falling observers is studied, as well as general geodesic completeness.