title: "Turing Tests" For An AI Scientist

abstract: While LLMs have shown impressive capabilities in solving math or coding problems, the ability to make scientific discoveries remains a distinct challenge. This paper proposes a "Turing test for an AI scientist" to assess whether an AI agent can conduct scientific research independently, without relying on human-generated knowledge. Drawing inspiration from the historical development of science, we propose seven benchmark tests that evaluate an AI agent's ability to make groundbreaking discoveries in various scientific domains. These tests include inferring the heliocentric model from celestial observations, discovering the laws of motion in a simulated environment, deriving the differential equation governing vibrating strings, inferring Maxwell's equations from electrodynamics simulations, inventing numerical methods for initial value problems, discovering Huffman coding for data compression, and developing efficient sorting algorithms. To ensure the validity of these tests, the AI agent is provided with interactive libraries or datasets specific to each problem, without access to human knowledge that could potentially contain information about the target discoveries. The ultimate goal is to create an AI scientist capable of making novel and impactful scientific discoveries, surpassing the best human experts in their respective fields. These "Turing tests" serve as intermediate milestones, assessing the AI agent's ability to make discoveries that were groundbreaking in their time. If an AI agent can pass the majority of these seven tests, it would indicate significant progress towards building an AI scientist, paving the way for future advancements in autonomous scientific discovery. This paper aims to establish a benchmark for the capabilities of AI in scientific research and to stimulate further research in this exciting field.


title: Adaptive Bayesian Multivariate Spline Knot Inference with Prior Specifications on Model Complexity

abstract: In multivariate spline regression, the number and locations of knots influence the performance and interpretability significantly. However, due to non-differentiability and varying dimensions, there is no desirable frequentist method to make inference on knots. In this article, we propose a fully Bayesian approach for knot inference in multivariate spline regression. The existing Bayesian method often uses BIC to calculate the posterior, but BIC is too liberal and it will heavily overestimate the knot number when the candidate model space is large. We specify a new prior on the knot number to take into account the complexity of the model space and derive an analytic formula in the normal model. In the non-normal cases, we utilize the extended Bayesian information criterion to approximate the posterior density. The samples are simulated in the space with differing dimensions via reversible jump Markov chain Monte Carlo. We apply the proposed method in knot inference and manifold denoising. Experiments demonstrate the splendid capability of the algorithm, especially in function fitting with jumping discontinuity.


title: Some Classes of Interacting Two-Fluid Model of the Expanding Universe

abstract: We consider interacting dark matter-dark energy models arising out of a general interaction term $Q=f(\rho_{m},\rho_{d},\dot{\rho}_{m},\dot{\rho}_{d}).$ Here $f$ is a functional relation connecting the energy densities $\rho_{m}$ and $\rho_{d}$ and their derivatives w.r.t. time $t.$ In our model we consider two interacting barotropic fluid with constant equation of state $\omega_{m}$ and $\omega_{d}.$ By considering a dynamical interaction between them we trace out the cosmological evolution dynamics of the universe. We analytically solve the model by considering a constant ratio between the two fluids and then track the corresponding analytical results using observational data from the baryon acoustic oscillation measurements, Type Ia supernovae measurements and the local Hubble constant measurements. From this general setting we introduce three different models and nine different interaction function. Our final aim is to set up a comparative analysis of the various class of models under the different interaction function using common theoretical and numerical analysis.


title: Geodesic nature and quantization of shift vector

abstract: We present the geodesic nature and quantization of geometric shift vector in quantum systems, with the parameter space defined by the Bloch momentum, using the Wilson loop approach. Our analysis extends to include bosonic phonon drag shift vectors with non-vertical transitions. We demonstrate that the gauge invariant shift vector can be quantized as integer values, analogous to the Euler characteristic based on the Gauss-Bonnet theorem for a manifold with a smooth boundary. We reveal intricate relationships among geometric quantities such as the shift vector, Berry curvature, and quantum metric. Our findings demonstrate that the loop integral of the shift vector in the quantized interband formula contributes to the non-quantized component of the trace of conductivity in the circular photogalvanic effect. The Wilson loop method facilitates first-principles calculations, providing insights in the geometric underpinnings of these interband gauge invariant quantities and shedding light on their nonlinear optical manifestations in real materials.


title: Large Language Models (LLMs) Assisted Wireless Network Deployment in Urban Settings

abstract: The advent of Large Language Models (LLMs) has revolutionized language understanding and human-like text generation, drawing interest from many other fields with this question in mind: What else are the LLMs capable of? Despite their widespread adoption, ongoing research continues to explore new ways to integrate LLMs into diverse systems. This paper explores new techniques to harness the power of LLMs for 6G (6th Generation) wireless communication technologies, a domain where automation and intelligent systems are pivotal. The inherent adaptability of LLMs to domain-specific tasks positions them as prime candidates for enhancing wireless systems in the 6G landscape. We introduce a novel Reinforcement Learning (RL) based framework that leverages LLMs for network deployment in wireless communications. Our approach involves training an RL agent, utilizing LLMs as its core, in an urban setting to maximize coverage. The agent's objective is to navigate the complexities of urban environments and identify the network parameters for optimal area coverage. Additionally, we integrate LLMs with Convolutional Neural Networks (CNNs) to capitalize on their strengths while mitigating their limitations. The Deep Deterministic Policy Gradient (DDPG) algorithm is employed for training purposes. The results suggest that LLM-assisted models can outperform CNN-based models in some cases while performing at least as well in others.


title: Enhanced Creativity and Ideation through Stable Video Synthesis

abstract: This paper explores the innovative application of Stable Video Diffusion (SVD), a diffusion model that revolutionizes the creation of dynamic video content from static images. As digital media and design industries accelerate, SVD emerges as a powerful generative tool that enhances productivity and introduces novel creative possibilities. The paper examines the technical underpinnings of diffusion models, their practical effectiveness, and potential future developments, particularly in the context of video generation. SVD operates on a probabilistic framework, employing a gradual denoising process to transform random noise into coherent video frames. It addresses the challenges of visual consistency, natural movement, and stylistic reflection in generated videos, showcasing high generalization capabilities. The integration of SVD in design tasks promises enhanced creativity, rapid prototyping, and significant time and cost efficiencies. It is particularly impactful in areas requiring frame-to-frame consistency, natural motion capture, and creative diversity, such as animation, visual effects, advertising, and educational content creation. The paper concludes that SVD is a catalyst for design innovation, offering a wide array of applications and a promising avenue for future research and development in the field of digital media and design.


title: AdpQ: A Zero-shot Calibration Free Adaptive Post Training Quantization Method for LLMs

abstract: The ever-growing computational complexity of Large Language Models (LLMs) necessitates efficient deployment strategies. The current state-of-the-art approaches for Post-training Quantization (PTQ) often require calibration to achieve the desired accuracy. This paper presents AdpQ, a novel zero-shot adaptive PTQ method for LLMs that achieves the state-of-the-art performance in low-precision quantization (e.g. 3-bit) without requiring any calibration data. Inspired by Adaptive LASSO regression model, our proposed approach tackles the challenge of outlier activations by separating salient weights using an adaptive soft-thresholding method. Guided by Adaptive LASSO, this method ensures that the quantized weights distribution closely follows the originally trained weights and eliminates the need for calibration data entirely, setting our method apart from popular approaches such as SpQR and AWQ. Furthermore, our method offers an additional benefit in terms of privacy preservation by eliminating any calibration or training data. We also delve deeper into the information-theoretic underpinnings of the proposed method. We demonstrate that it leverages the Adaptive LASSO to minimize the Kullback-Leibler divergence between the quantized weights and the originally trained weights. This minimization ensures the quantized model retains the Shannon information content of the original model to a great extent, guaranteeing efficient deployment without sacrificing accuracy or information. Our results achieve the same accuracy as the existing methods on various LLM benchmarks while the quantization time is reduced by at least 10x, solidifying our contribution to efficient and privacy-preserving LLM deployment.


title: A note on analogue semi-classical gravity in (1+1) dimensions

abstract: Acoustic spacetimes have been known to offer analogue models for black hole physics and cosmology. Within this context, aspects of analogue quantum field theories in curved spacetime are studied. In particular some new comments have been made on the analogue Hawking temperature including a quick derivation of the result. Further, analogue cosmology is explored, within which, an acoustic version of the Parker-Toms model is proposed and the corresponding quantities have been calculated. The limits of the acoustic analogue are emphasised.


title: How to Trace Latent Generative Model Generated Images without Artificial Watermark?

abstract: Latent generative models (e.g., Stable Diffusion) have become more and more popular, but concerns have arisen regarding potential misuse related to images generated by these models. It is, therefore, necessary to analyze the origin of images by inferring if a particular image was generated by a specific latent generative model. Most existing methods (e.g., image watermark and model fingerprinting) require extra steps during training or generation. These requirements restrict their usage on the generated images without such extra operations, and the extra required operations might compromise the quality of the generated images. In this work, we ask whether it is possible to effectively and efficiently trace the images generated by a specific latent generative model without the aforementioned requirements. To study this problem, we design a latent inversion based method called LatentTracer to trace the generated images of the inspected model by checking if the examined images can be well-reconstructed with an inverted latent input. We leverage gradient based latent inversion and identify a encoder-based initialization critical to the success of our approach. Our experiments on the state-of-the-art latent generative models, such as Stable Diffusion, show that our method can distinguish the images generated by the inspected model and other images with a high accuracy and efficiency. Our findings suggest the intriguing possibility that today's latent generative generated images are naturally watermarked by the decoder used in the source models. Code: https://github.com/ZhentingWang/LatentTracer.


title: Mechanistic Insights into Non-Adiabatic Interband Transitions on a Semiconductor Surface Induced by Hydrogen Atom Collisions

abstract: To understand the recently observed mysterious non-adiabatic energy transfer for hyperthermal H atom scattering from a semiconductor surface, Ge(111)c(2*8), we present a mixed quantum-classical non-adiabatic molecular dynamics model based on time-dependent evolution of Kohn-Sham orbitals and a classical path approximation. Our results suggest that facile non-adiabatic transitions occur selectively at the rest atom site, featuring excitation of valance band electrons to the conduction band, but not at the adatom site. This drastic site specificity can be attributed to the changes of the local band structure upon energetic H collisions at different surface sites, leading to transient near-degeneracies and significant couplings between occupied and unoccupied orbitals at the rest atom, but not at the adatom. These insights shed valuable light on the collisional induced non-adiabatic dynamics at semiconductor surfaces.


title: Lusifer: LLM-based User SImulated Feedback Environment for online Recommender systems

abstract: Training reinforcement learning-based recommender systems are often hindered by the lack of dynamic and realistic user interactions. Lusifer, a novel environment leveraging Large Language Models (LLMs), addresses this limitation by generating simulated user feedback. It synthesizes user profiles and interaction histories to simulate responses and behaviors toward recommended items. In addition, user profiles are updated after each rating to reflect evolving user characteristics. Using the MovieLens100K dataset as proof of concept, Lusifer demonstrates accurate emulation of user behavior and preferences. This paper presents Lusifer's operational pipeline, including prompt generation and iterative user profile updates. While validating Lusifer's ability to produce realistic dynamic feedback, future research could utilize this environment to train reinforcement learning systems, offering a scalable and adjustable framework for user simulation in online recommender systems.


title: Competition-common enemy graphs of degree-bounded digraphs

abstract: The competition-common enemy graph (CCE graph) of a digraph $D$ is the graph with the vertex set $V(D)$ and an edge $uv$ if and only if $u$ and $v$ have a common predator and a common prey in $D$. If each vertex of a digraph $D$ has indegree at most $i$ and outdegree at most $j$, then $D$ is called an $\langle i,j \rangle$ digraph. In this paper, we fully characterize the CCE graphs of $\langle 2,2\rangle$ digraphs. Then we investigate the CCE graphs of acyclic $\langle 2,2 \rangle$ digraphs, and prove that any CCE graph of an acyclic $\langle 2,2 \rangle$ digraph with at most seven components is interval, and the bound is sharp. While characterizing acyclic $\langle 2,2 \rangle$ digraphs that have interval graphs as their competition graphs, Hefner~{\it et al}. (1991) initiated the study of competition graphs of degree-bounded digraphs. Recently, Lee~{\em et al}. (2017) and Eoh and Kim (2021) studied phylogeny graphs of degree-bounded digraphs to extend their work.


title: LucidRaster: GPU Software Rasterizer for Exact Order-Independent Transparency

abstract: Transparency rendering is problematic and can be considered an open problem in real-time graphics. There are many different algorithms currently available, but handling complex scenes and achieving accurate, glitch-free results is still costly. This paper describes LucidRaster: a software rasterizer running on a GPU which allows for efficient exact rendering of complex transparent scenes. It uses a new two-stage sorting technique and sample accumulation method. On average it's faster than high-quality OIT approximations and only about 3x slower than hardware alpha blending. It can be very efficient especially when rendering scenes with high triangle density or high depth complexity.


title: Clipped Uniform Quantizers for Communication-Efficient Federated Learning

abstract: This paper introduces an approach to employ clipped uniform quantization in federated learning settings, aiming to enhance model efficiency by reducing communication overhead without compromising accuracy. By employing optimal clipping thresholds and adaptive quantization schemes, our method significantly curtails the bit requirements for model weight transmissions between clients and the server. We explore the implications of symmetric clipping and uniform quantization on model performance, highlighting the utility of stochastic quantization to mitigate quantization artifacts and improve model robustness. Through extensive simulations on the MNIST dataset, our results demonstrate that the proposed method achieves near full-precision performance while ensuring substantial communication savings. Specifically, our approach facilitates efficient weight averaging based on quantization errors, effectively balancing the trade-off between communication efficiency and model accuracy. The comparative analysis with conventional quantization methods further confirms the superiority of our technique.


title: Anticipating Optical Availability in Hybrid RF/FSO Links Using RF Beacons and Deep Learning

abstract: Radio frequency (RF) communications offer reliable but low data rates and energy-inefficient satellite links, while free-space optical (FSO) promises high bandwidth but struggles with disturbances imposed by atmospheric effects. A hybrid RF/FSO architecture aims to achieve optimal reliability along with high data rates for space communications. Accurate prediction of dynamic ground-to-satellite FSO link availability is critical for routing decisions in low-earth orbit constellations. In this paper, we propose a system leveraging ubiquitous RF links to proactively forecast FSO link degradation prior to signal drops below threshold levels. This enables pre-calculation of rerouting to maximally maintain high data rate FSO links throughout the duration of weather effects. We implement a supervised learning model to anticipate FSO attenuation based on the analysis of RF patterns. Through the simulation of a dense lower earth orbit (LEO) satellite constellation, we demonstrate the efficacy of our approach in a simulated satellite network, highlighting the balance between predictive accuracy and prediction duration. An emulated cloud attenuation model is proposed which provides insight into the temporal profiles of RF signals and their correlation to FSO channel dynamics. Our investigation sheds light on the trade-offs between prediction horizon and accuracy arising from RF beacon proximity, achieving a prediction accuracy of 86\% with 16 RF beacons.


title: End-to-End Learning of Pulse-Shaper and Receiver Filter in the Presence of Strong Intersymbol Interference

abstract: We numerically demonstrate that joint optimization of FIR based pulse-shaper and receiver filter results in an improved system performance, and shorter filter lengths (lower complexity), for 4-PAM 100 GBd IM/DD systems.


title: Static Deep Q-learning for Green Downlink C-RAN

abstract: Power saving is a main pillar in the operation of wireless communication systems. In this paper, we investigate cloud radio access network (C-RAN) capability to reduce power consumption based on the user equipment (UE) requirement. Aiming to save the long-term C-RAN energy consumption, an optimization problem is formulated to manage the downlink power without degrading the UE requirement by designing the power offset parameter. Considering stochastic traffic arrivals at UEs, we first formulate the problem as a Markov decision process (MDP) and then set up a dual objective optimization problem in terms of the downlink throughput and power. To solve this optimization problem, we develop a novel static deep Q-learning (SDQL) algorithm to maximize the downlink throughput and minimize the downlink power. In our proposed algorithm, we design multi-Q-tables to simultaneously optimize power reductions of activated RRHs by assigning one Q-table for each UE. To maximize the accumulative reward in terms of the downlink throughput loss and power reduction, our proposed algorithm performs power reductions of activated RRHs through continuous environmental interactions. Simulation results1 show that our proposed algorithm enjoys a superior average power reduction compared to the activation and sleep schemes, and enjoys a low computational complexity.


title: Realization of a crosstalk-free multi-ion node for long-distance quantum networking

abstract: Trapped atomic ions constitute one of the leading physical platforms for building the quantum repeater nodes to realize large-scale quantum networks. In a long-distance trapped-ion quantum network, it is essential to have crosstalk-free dual-type qubits: one type, called the communication qubit, to establish entangling interface with telecom photons; and the other type, called the memory qubit, to store quantum information immune from photon scattering under entangling attempts. Here, we report the first experimental implementation of a telecom-compatible and crosstalk-free quantum network node based on two trapped $^{40}$Ca$^{+}$ ions. The memory qubit is encoded on a long-lived metastable level to avoid crosstalk with the communication qubit encoded in another subspace of the same ion species, and a quantum wavelength conversion module is employed to generate ion-photon entanglement over a $12\,$km fiber in a heralded style. Our work therefore constitutes an important step towards the realization of quantum repeaters and long-distance quantum networks.


title: Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning

abstract: This research addresses the challenges of diagnosing chest X-rays (CXRs) at low resolutions, a common limitation in resource-constrained healthcare settings. High-resolution CXR imaging is crucial for identifying small but critical anomalies, such as nodules or opacities. However, when images are downsized for processing in Computer-Aided Diagnosis (CAD) systems, vital spatial details and receptive fields are lost, hampering diagnosis accuracy. To address this, this paper presents the Multilevel Collaborative Attention Knowledge (MLCAK) method. This approach leverages the self-attention mechanism of Vision Transformers (ViT) to transfer critical diagnostic knowledge from high-resolution images to enhance the diagnostic efficacy of low-resolution CXRs. MLCAK incorporates local pathological findings to boost model explainability, enabling more accurate global predictions in a multi-task framework tailored for low-resolution CXR analysis. Our research, utilizing the Vindr CXR dataset, shows a considerable enhancement in the ability to diagnose diseases from low-resolution images (e.g. 28 x 28), suggesting a critical transition from the traditional reliance on high-resolution imaging (e.g. 224 x 224).


title: Faster Vizing and Near-Vizing Edge Coloring Algorithms

abstract: Vizing's celebrated theorem states that every simple graph with maximum degree $\Delta$ admits a $(\Delta+1)$ edge coloring which can be found in $O(m \cdot n)$ time on $n$-vertex $m$-edge graphs. This is just one color more than the trivial lower bound of $\Delta$ colors needed in any proper edge coloring. After a series of simplifications and variations, this running time was eventually improved by Gabow, Nishizeki, Kariv, Leven, and Terada in 1985 to $O(m\sqrt{n\log{n}})$ time. This has effectively remained the state-of-the-art modulo an $O(\sqrt{\log{n}})$-factor improvement by Sinnamon in 2019. As our main result, we present a novel randomized algorithm that computes a $\Delta+O(\log{n})$ coloring of any given simple graph in $O(m\log{\Delta})$ expected time; in other words, a near-linear time randomized algorithm for a ``near''-Vizing's coloring. As a corollary of this algorithm, we also obtain the following results: * A randomized algorithm for $(\Delta+1)$ edge coloring in $O(n^2\log{n})$ expected time. This is near-linear in the input size for dense graphs and presents the first polynomial time improvement over the longstanding bounds of Gabow et.al. for Vizing's theorem in almost four decades. * A randomized algorithm for $(1+\varepsilon) \Delta$ edge coloring in $O(m\log{(1/\varepsilon)})$ expected time for any $\varepsilon = \omega(\log{n}/\Delta)$. The dependence on $\varepsilon$ exponentially improves upon a series of recent results that obtain algorithms with runtime of $\Omega(m/\varepsilon)$ for this problem.


title: Ada-HGNN: Adaptive Sampling for Scalable Hypergraph Neural Networks

abstract: Hypergraphs serve as an effective model for depicting complex connections in various real-world scenarios, from social to biological networks. The development of Hypergraph Neural Networks (HGNNs) has emerged as a valuable method to manage the intricate associations in data, though scalability is a notable challenge due to memory limitations. In this study, we introduce a new adaptive sampling strategy specifically designed for hypergraphs, which tackles their unique complexities in an efficient manner. We also present a Random Hyperedge Augmentation (RHA) technique and an additional Multilayer Perceptron (MLP) module to improve the robustness and generalization capabilities of our approach. Thorough experiments with real-world datasets have proven the effectiveness of our method, markedly reducing computational and memory demands while maintaining performance levels akin to conventional HGNNs and other baseline models. This research paves the way for improving both the scalability and efficacy of HGNNs in extensive applications. We will also make our codebase publicly accessible.


title: No Drama in 2D Black Hole Evaporation

abstract: We numerically calculate the spacetime describing the formation and evaporation of a regular black hole in 2D dilaton gravity. The apparent horizons evaporate smoothly in finite time to form a compact trapped region. The spacetime is asymptotically flat at future null infinity and is free of singularities and global horizons. We nevertheless see rich dynamics; an anti-trapped region forms alongside the black hole, and additional compact trapped/anti-trapped regions are formed by backreaction effects as the mass radiates away. These results suggest that the evaporation of regular 2D black holes is unitary.


title: Collaboration of Teachers for Semi-supervised Object Detection

abstract: Recent semi-supervised object detection (SSOD) has achieved remarkable progress by leveraging unlabeled data for training. Mainstream SSOD methods rely on Consistency Regularization methods and Exponential Moving Average (EMA), which form a cyclic data flow. However, the EMA updating training approach leads to weight coupling between the teacher and student models. This coupling in a cyclic data flow results in a decrease in the utilization of unlabeled data information and the confirmation bias on low-quality or erroneous pseudo-labels. To address these issues, we propose the Collaboration of Teachers Framework (CTF), which consists of multiple pairs of teacher and student models for training. In the learning process of CTF, the Data Performance Consistency Optimization module (DPCO) informs the best pair of teacher models possessing the optimal pseudo-labels during the past training process, and these most reliable pseudo-labels generated by the best performing teacher would guide the other student models. As a consequence, this framework greatly improves the utilization of unlabeled data and prevents the positive feedback cycle of unreliable pseudo-labels. The CTF achieves outstanding results on numerous SSOD datasets, including a 0.71% mAP improvement on the 10% annotated COCO dataset and a 0.89% mAP improvement on the VOC dataset compared to LabelMatch and converges significantly faster. Moreover, the CTF is plug-and-play and can be integrated with other mainstream SSOD methods.


title: Adaptive Data Analysis for Growing Data

abstract: Reuse of data in adaptive workflows poses challenges regarding overfitting and the statistical validity of results. Previous work has demonstrated that interacting with data via differentially private algorithms can mitigate overfitting, achieving worst-case generalization guarantees with asymptotically optimal data requirements. However, such past work assumes data is static and cannot accommodate situations where data grows over time. In this paper we address this gap, presenting the first generalization bounds for adaptive analysis in the dynamic data setting. We allow the analyst to adaptively schedule their queries conditioned on the current size of the data, in addition to previous queries and responses. We also incorporate time-varying empirical accuracy bounds and mechanisms, allowing for tighter guarantees as data accumulates. In a batched query setting, the asymptotic data requirements of our bound grows with the square-root of the number of adaptive queries, matching prior works' improvement over data splitting for the static setting. We instantiate our bound for statistical queries with the clipped Gaussian mechanism, where it empirically outperforms baselines composed from static bounds.


title: Markerless retro-identification complements re-identification of individual insect subjects in archived image data of biological experiments

abstract: This study introduces markerless retro-identification of animals, a novel concept and practical technique to identify past occurrences of organisms in archived data, that complements traditional forward-looking chronological re-identification methods in longitudinal behavioural research. Identification of a key individual among multiple subjects may occur late in an experiment if it reveals itself through interesting behaviour after a period of undifferentiated performance. Often, longitudinal studies also encounter subject attrition during experiments. Effort invested in training software models to recognise and track such individuals is wasted if they fail to complete the experiment. Ideally, we would be able to select individuals who both complete an experiment and/or differentiate themselves via interesting behaviour, prior to investing computational resources in training image classification software to recognise them. We propose retro-identification for model training to achieve this aim. This reduces manual annotation effort and computational resources by identifying subjects only after they differentiate themselves late, or at an experiment's conclusion. Our study dataset comprises observations made of morphologically similar reed bees (\textit{Exoneura robusta}) over five days. We evaluated model performance by training on final day five data, testing on the sequence of preceding days, and comparing results to the usual chronological evaluation from day one. Results indicate no significant accuracy difference between models. This underscores retro-identification's value in improving resource efficiency in longitudinal animal studies.


title: Kinematics of Abdominal Aortic Aneurysms

abstract: A search in Scopus within "Article title, Abstract, Keywords" unveils 2,444 documents focused on the biomechanics of Abdominal Aortic Aneurysm (AAA), mostly on AAA wall stress. Only 24 documents investigated AAA kinematics, an important topic that could potentially offer insights into the biomechanics of AAA. In this paper, we present an image-based approach for patient-specific, in vivo, and non-invasive AAA kinematic analysis using patient's time-resolved 3D computed tomography angiography (4D CTA) images. Our approach relies on regularized deformable image registration for estimating wall displacement, estimation of the local wall strain as the ratio of its normal displacement to its local radius of curvature, and local surface fitting with non-deterministic outlier detection for estimating the wall radius of curvature. We verified our approach against synthetic ground truth image data created by warping a 3D CTA image of AAA using a realistic displacement field obtained from a finite element biomechanical model. We applied our approach to assess AAA wall displacements and strains in ten patients. Our kinematic analysis results indicated that the 99th percentile of circumferential wall strain, among all patients, ranged from 3.16% to 7.31%, with an average of 5.36% and a standard deviation of 1.28%.


title: FedCache 2.0: Exploiting the Potential of Distilled Data in Knowledge Cache-driven Federated Learning

abstract: Federated Edge Learning (FEL) has emerged as a promising approach for enabling edge devices to collaboratively train machine learning models while preserving data privacy. Despite its advantages, practical FEL deployment faces significant challenges related to device constraints and device-server interactions, necessitating heterogeneous, user-adaptive model training with limited and uncertain communication. In this paper, we introduce FedCache 2.0, a novel personalized FEL architecture that simultaneously addresses these challenges. FedCache 2.0 incorporates the benefits of both dataset distillation and knowledge cache-driven federated learning by storing and organizing distilled data as knowledge in the server-side knowledge cache. Moreover, a device-centric cache sampling strategy is introduced to tailor transferred knowledge for individual devices within controlled communication bandwidth. Extensive experiments on five datasets covering image recognition, audio understanding, and mobile sensor data mining tasks demonstrate that (1) FedCache 2.0 significantly outperforms state-of-the-art methods regardless of model structures, data distributions, and modalities. (2) FedCache 2.0 can train splendid personalized on-device models with at least $\times$28.6 improvement in communication efficiency.


title: You don't understand me!: Comparing ASR results for L1 and L2 speakers of Swedish

abstract: The performance of Automatic Speech Recognition (ASR) systems has constantly increased in state-of-the-art development. However, performance tends to decrease considerably in more challenging conditions (e.g., background noise, multiple speaker social conversations) and with more atypical speakers (e.g., children, non-native speakers or people with speech disorders), which signifies that general improvements do not necessarily transfer to applications that rely on ASR, e.g., educational software for younger students or language learners. In this study, we focus on the gap in performance between recognition results for native and non-native, read and spontaneous, Swedish utterances transcribed by different ASR services. We compare the recognition results using Word Error Rate and analyze the linguistic factors that may generate the observed transcription errors.


title: The Illusion of Anonymity: Uncovering the Impact of User Actions on Privacy in Web3 Social Ecosystems

abstract: The rise of Web3 social ecosystems signifies the dawn of a new chapter in digital interaction, offering significant prospects for user engagement and financial advancement. Nonetheless, this progress is shadowed by potential privacy concessions, especially as these platforms frequently merge with existing Web2.0 social media accounts, amplifying data privacy risks for users. In this study, we investigate the nuanced dynamics between user engagement on Web3 social platforms and the consequent privacy concerns. We scrutinize the widespread phenomenon of fabricated activities, which encompasses the establishment of bogus accounts aimed at mimicking popularity and the deliberate distortion of social interactions by some individuals to gain financial rewards. Such deceptive maneuvers not only distort the true measure of the active user base but also amplify privacy threats for all members of the user community. We also find that, notwithstanding their attempts to limit social exposure, users remain entangled in privacy vulnerabilities. The actions of those highly engaged users, albeit often a minority group, can inadvertently breach the privacy of the larger collective. By casting light on the delicate interplay between user engagement, financial motives, and privacy issues, we offer a comprehensive examination of the intrinsic challenges and hazards present in the Web3 social milieu. We highlight the urgent need for more stringent privacy measures and ethical protocols to navigate the complex web of social exchanges and financial ambitions in the rapidly evolving Web3.


title: Optimizing Search Advertising Strategies: Integrating Reinforcement Learning with Generalized Second-Price Auctions for Enhanced Ad Ranking and Bidding

abstract: This paper explores the integration of strategic optimization methods in search advertising, focusing on ad ranking and bidding mechanisms within E-commerce platforms. By employing a combination of reinforcement learning and evolutionary strategies, we propose a dynamic model that adjusts to varying user interactions and optimizes the balance between advertiser cost, user relevance, and platform revenue. Our results suggest significant improvements in ad placement accuracy and cost efficiency, demonstrating the model's applicability in real-world scenarios.


title: VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding

abstract: Video Temporal Grounding (VTG) focuses on accurately identifying event timestamps within a particular video based on a linguistic query, playing a vital role in downstream tasks such as video browsing and editing. While Video Large Language Models (video LLMs) have made significant progress in understanding video content, they often face challenges in accurately pinpointing timestamps within videos, which limits their performance on VTG tasks. Therefore, to improve video LLMs' ability to effectively locate timestamps, we argue that two critical aspects need to be enhanced. First, it is essential to have high-quality instructional tuning datasets that encompass mainstream VTG tasks. Second, directly incorporating timestamp knowledge into video LLMs is crucial, as it enables models to efficiently comprehend timestamp information. To address these needs, we first introduce VTG-IT-120K, a high-quality and comprehensive instruction tuning dataset that covers VTG tasks such as moment retrieval, dense video captioning, video summarization, and video highlight detection. Furthermore, we propose a specially designed video LLM model for VTG tasks, VTG-LLM, which (1) effectively integrates timestamp knowledge into visual tokens; (2) incorporates absolute-time tokens that specifically handle timestamp knowledge, thereby avoiding concept shifts; and (3) introduces a lightweight, high-performance slot-based token compression method to facilitate the sampling of more video frames. Comprehensive experiments showcase the superior performance of VTG-LLM in comparison to other video LLM methods across various VTG tasks. Our code and datasets are available at \url{https://github.com/gyxxyg/VTG-LLM}.


title: Gradient Projection For Parameter-Efficient Continual Learning

abstract: Catastrophic forgetting poses the primary challenge in the continual learning. Nowadays, methods based on parameter-efficient tuning (PET) have demonstrated impressive performance in continual learning. However, these methods are still confronted with a common problem: fine-tuning on consecutive distinct tasks can disrupt the existing parameter distribution and lead to forgetting. Recent progress mainly focused in empirically designing efficient tuning engineering, lacking investigation of forgetting generation mechanism, anti-forgetting criteria and providing theoretical support. Additionally, the unresolved trade-off between learning new content and protecting old knowledge further complicates these challenges. The gradient projection methodology restricts gradient updates to the orthogonal direction of the old feature space, preventing distribution of the parameters from being damaged during updating and significantly suppressing forgetting. Developing on it, in this paper, we reformulate Adapter, LoRA, Prefix, and Prompt to continual learning setting from the perspective of gradient projection, and propose a unified framework called Parameter Efficient Gradient Projection (PEGP). Based on the hypothesis that old tasks should have the same results after model updated, we introduce orthogonal gradient projection into different PET paradigms and theoretically demonstrate that the orthogonal condition for the gradient can effectively resist forgetting in PET-based continual methods. Notably, PEGP is the first unified method to provide an anti-forgetting mechanism with mathematical demonstration for different tuning paradigms. We extensively evaluate our method with different backbones on diverse datasets, and experiments demonstrate its efficiency in reducing forgetting in various incremental settings.


title: Elastic-gap free strain gradient crystal plasticity model that effectively account for plastic slip gradient and grain boundary dissipation

abstract: This paper proposes an elastic-gap free strain gradient crystal plasticity model that addresses dissipation caused by plastic slip gradient and grain boundary (GB) Burger tensor. The model involves splitting plastic slip gradient and GB Burger tensor into energetic dissipative quantities. Unlike conventional models, the bulk and GB defect energy are considered to be a quadratic functional of the energetic portion of slip gradient and GB Burgers tensor. The higher-order stresses for each individual slip systems and GB stresses are derived from the defect energy, following a similar evolution as the Armstrong-Frederick type backstress model in classical plasticity. The evolution equations consist of a hardening and a relaxation term. The relaxation term brings the nonlinearity in hardening and causes an additional dissipation. The applicability of the proposed model is numerically established with the help of two-dimensional finite element implementation. Specifically, the bulk and GB relaxation coefficients are critically evaluated based on various circumstances, considering single crystal infinite shear layer, periodic bicrystal shearing, and bicrystal tension problem. In contrast to the Gurtin-type model, the proposed model smoothly captures the apparent strengthening at saturation without causing any abrupt stress jump under non-proportional loading conditions. Moreover, when subjected to cyclic loading, the stress-strain curve maintains its curvature during reverse loading. The numerical simulation reveals that the movement of geometrically necessary dislocation (GND) towards the GB is influenced by the bulk recovery coefficient, while the dissipation and amount of accumulation of GND near the GB are controlled by the GB recovery coefficient.


title: Minimal Finite Model of Wedge Sum of Spheres

abstract: In \cite{Barmak(2007),Barmak(2011)}, Barmak extensively investigates the minimal finite models of the n-dimensional sphere $S^n$ for all $n\geq 0$ and establishes the minimal finite model of the wedge sum of unit circles $\bigvee\limits_{i= 1}^{n} S^{1}$. In this work, we demonstrate that the minimal finite model of the M$\ddot{\rm{o}}$bius band coincides with the minimal finite model of the unit circle $S^1$. Furthermore, we establish that the minimal finite models of the spaces $S^{2}\vee S^{1}$, $S^{2}\vee S^{2}$ consist of only seven points, while the minimal finite models of the spaces $S^{1}\vee S^{1}\vee S^{2}$ and $S^{2}\vee S^{2}\vee S^{1}$ contain eight points. Additionally, we thoroughly discuss all the necessary homotopy groups and homology groups of the aforementioned spaces to provide a comprehensive and self-contained presentation in the paper.


title: 360Zhinao Technical Report

abstract: We present 360Zhinao models with 7B parameter size and context lengths spanning 4K, 32K and 360K, all available at https://github.com/Qihoo360/360zhinao. For rapid development in pretraining, we establish a stable and sensitive ablation environment to evaluate and compare experiment runs with minimal model size. Under such guidance, we perfect our data cleaning and composition strategies to pretrain $\texttt{360Zhinao-7B-Base}$ on 3.4T tokens. We also mainly emphasize data during alignment, where we strive to balance quantity and quality with filtering and reformatting. With tailored data, 360Zhinao-7B's context window is easily extended to 32K and 360K. RMs and RLHF are trained following SFT and credibly applied to specific tasks. All together these contributions lead to 360Zhinao-7B's competitive performance among models of similar size.


title: Quantization dimensions of negative order

abstract: In this note, we investigate the possibility of defining meaningful upper and lower quantization dimensions for a compactly supported Borel probability measure of order $r$, also for negative values of $r$. To this end, we utilize the concept of partition functions, which generalizes the idea of the $L^{q}$-spectrum and, in this way, naturally extends the work in [M. Kesseb\"ohmer, A. Niemann, and S. Zhu. Quantization dimensions of probability measures via R\'enyi dimensions. $\textit{Trans. Amer. Math. Soc.}$ 376.7 (2023), 4661$\unicode{x2013}$4678]. In particular, we provide natural fractal geometric bounds as well as easily verifiable necessary conditions for the existence of the quantization dimensions. Exact asymptotics for the absolutely continuous case are also given.


title: Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentation

abstract: In recent times, following the paradigm of DETR (DEtection TRansformer), query-based end-to-end instance segmentation (QEIS) methods have exhibited superior performance compared to CNN-based models, particularly when trained on large-scale datasets. Nevertheless, the effectiveness of these QEIS methods diminishes significantly when confronted with limited training data. This limitation arises from their reliance on substantial data volumes to effectively train the pivotal queries/kernels that are essential for acquiring localization and shape priors. To address this problem, we propose a novel method for unsupervised pre-training in low-data regimes. Inspired by the recently successful prompting technique, we introduce a new method, Unsupervised Pre-training with Language-Vision Prompts (UPLVP), which improves QEIS models' instance segmentation by bringing language-vision prompts to queries/kernels. Our method consists of three parts: (1) Masks Proposal: Utilizes language-vision models to generate pseudo masks based on unlabeled images. (2) Prompt-Kernel Matching: Converts pseudo masks into prompts and injects the best-matched localization and shape features to their corresponding kernels. (3) Kernel Supervision: Formulates supervision for pre-training at the kernel level to ensure robust learning. With the help of our pre-training method, QEIS models can converge faster and perform better than CNN-based models in low-data regimes. Experimental evaluations conducted on MS COCO, Cityscapes, and CTW1500 datasets indicate that the QEIS models' performance can be significantly improved when pre-trained with our method. Code will be available at: https://github.com/lifuguan/UPLVP.


title: HR-INR: Continuous Space-Time Video Super-Resolution via Event Camera

abstract: Continuous space-time video super-resolution (C-STVSR) aims to simultaneously enhance video resolution and frame rate at an arbitrary scale. Recently, implicit neural representation (INR) has been applied to video restoration, representing videos as implicit fields that can be decoded at an arbitrary scale. However, the highly ill-posed nature of C-STVSR limits the effectiveness of current INR-based methods: they assume linear motion between frames and use interpolation or feature warping to generate features at arbitrary spatiotemporal positions with two consecutive frames. This restrains C-STVSR from capturing rapid and nonlinear motion and long-term dependencies (involving more than two frames) in complex dynamic scenes. In this paper, we propose a novel C-STVSR framework, called HR-INR, which captures both holistic dependencies and regional motions based on INR. It is assisted by an event camera, a novel sensor renowned for its high temporal resolution and low latency. To fully utilize the rich temporal information from events, we design a feature extraction consisting of (1) a regional event feature extractor - taking events as inputs via the proposed event temporal pyramid representation to capture the regional nonlinear motion and (2) a holistic event-frame feature extractor for long-term dependence and continuity motion. We then propose a novel INR-based decoder with spatiotemporal embeddings to capture long-term dependencies with a larger temporal perception field. We validate the effectiveness and generalization of our method on four datasets (both simulated and real data), showing the superiority of our method.


title: Convergence analysis of kernel learning FBSDE filter

abstract: Kernel learning forward backward SDE filter is an iterative and adaptive meshfree approach to solve the nonlinear filtering problem. It builds from forward backward SDE for Fokker-Planker equation, which defines evolving density for the state variable, and employs KDE to approximate density. This algorithm has shown more superior performance than mainstream particle filter method, in both convergence speed and efficiency of solving high dimension problems. However, this method has only been shown to converge empirically. In this paper, we present a rigorous analysis to demonstrate its local and global convergence, and provide theoretical support for its empirical results.


title: Unitary Quantum Algorithm for the Lattice-Boltzmann Method

abstract: We present a quantum algorithm for computational fluid dynamics based on the Lattice-Boltzmann method. Our approach involves a novel encoding strategy and a modified collision operator, assuming full relaxation to the local equilibrium within a single time step. Our quantum algorithm enables the computation of multiple time steps in the linearized case, specifically for solving the advection-diffusion equation, before necessitating a full state measurement. Moreover, our formulation can be extended to compute the non-linear equilibrium distribution function for a single time step prior to measurement, utilizing the measurement as an essential algorithmic step. However, in the non-linear case, a classical postprocessing step is necessary for computing the moments of the distribution function. We validate our algorithm by solving the one dimensional advection-diffusion of a Gaussian hill. Our results demonstrate that our quantum algorithm captures non-linearity.


title: Local convergence of min-max algorithms to differentiable equilibrium on Riemannian manifold

abstract: We study min-max algorithms to solve zero-sum differentiable games on Riemannian manifold. The notions of differentiable Stackelberg equilibrium and differentiable Nash equilibrium in Euclidean space are generalized to Riemannian manifold, through an intrinsic definition which does not depend on the choice of local coordinate chart of manifold. We then provide sufficient conditions for the local convergence of the deterministic simultaneous algorithms $\tau$-GDA and $\tau$-SGA near such equilibrium, using a general methodology based on spectral analysis. These algorithms are extended with stochastic gradients and applied to the training of Wasserstein GAN. The discriminator of GAN is constructed from Lipschitz-continuous functions based on Stiefel manifold. We show numerically how the insights obtained from the local convergence analysis may lead to an improvement of GAN models.


title: NFCL: Simply interpretable neural networks for a short-term multivariate forecasting

abstract: Multivariate time-series forecasting (MTSF) stands as a compelling field within the machine learning community. Diverse neural network based methodologies deployed in MTSF applications have demonstrated commendable efficacy. Despite the advancements in model performance, comprehending the rationale behind the model's behavior remains an enigma. Our proposed model, the Neural ForeCasting Layer (NFCL), employs a straightforward amalgamation of neural networks. This uncomplicated integration ensures that each neural network contributes inputs and predictions independently, devoid of interference from other inputs. Consequently, our model facilitates a transparent explication of forecast results. This paper introduces NFCL along with its diverse extensions. Empirical findings underscore NFCL's superior performance compared to nine benchmark models across 15 available open datasets. Notably, NFCL not only surpasses competitors but also provides elucidation for its predictions. In addition, Rigorous experimentation involving diverse model structures bolsters the justification of NFCL's unique configuration.


title: A theory of neural emulators

abstract: A central goal in neuroscience is to provide explanations for how animal nervous systems can generate actions and cognitive states such as consciousness while artificial intelligence (AI) and machine learning (ML) seek to provide models that are increasingly better at prediction. Despite many decades of research we have made limited progress on providing neuroscience explanations yet there is an increased use of AI and ML methods in neuroscience for prediction of behavior and even cognitive states. Here we propose emulator theory (ET) and neural emulators as circuit- and scale-independent predictive models of biological brain activity and emulator theory (ET) as an alternative research paradigm in neuroscience. ET proposes that predictive models trained solely on neural dynamics and behaviors can generate functionally indistinguishable systems from their sources. That is, compared to the biological organisms which they model, emulators may achieve indistinguishable behavior and cognitive states - including consciousness - without any mechanistic explanations. We posit ET via several conjectures, discuss the nature of endogenous and exogenous activation of neural circuits, and discuss neural causality of phenomenal states. ET provides the conceptual and empirical framework for prediction-based models of neural dynamics and behavior without explicit representations of idiosyncratically evolved nervous systems.


title: An in-depth analysis of the differentially expanding star cluster Stock 18 (Villafranca O-036) using Gaia DR3 and ground-based data

abstract: (ABRIDGED) CONTEXT: The Villafranca project is combining Gaia data with ground-based surveys to analyze Galactic stellar groups with OB stars. AIMS: We want to analyze Stock 18 within the Villafranca project, a very young stellar cluster with a symmetrical and compact H II region around it. METHODS: We analyze the core, massive-star population, extinction, distance, membership, internal dynamics, density profile, age, IMF, total mass, stellar variability, and Galactic location of Stock 18 with Gaia data and ground-based spectroscopy. RESULTS: Stock 18 is a very young (~1.0 Ma) cluster located at a distance of 2.91+-0.10 kpc dominated by the GLS 13 370 system, whose primary is an O9 V star. We propose that Stock 18 was in a very compact state (~0.1 pc) about 1.0 Ma ago and that most massive stars were ejected at that time without significantly affecting the less massive stars as a result of multi-body dynamical interactions. Given its age close to 1.0 Ma, the dynamical interactions took place very soon after massive star formation. Well defined expanding stellar clusters have been observed before but none as young as this one. The IMF is top heavy but if we discard the ejected ones it becomes nearly canonical. Therefore, this is another example in addition to the one we previously found (the Bermuda cluster) of (a) a very young cluster with an already evolved PDMF (b) that has significantly contributed to the future population of free-floating compact objects. If confirmed in more clusters, the number of such compact objects may be higher in the Milky Way than previously thought. Stock 18 has a variable extinction with an average value of R_5495 higher than the canonical one of 3.1. The cluster is above our Galactic mid-plane and has a distinct motion with respect to its surrounding old population, which is possibly an influence of the Perseus spiral arm.


title: Why In-Context Learning Transformers are Tabular Data Classifiers

abstract: The recently introduced TabPFN pretrains an In-Context Learning (ICL) transformer on synthetic data to perform tabular data classification. As synthetic data does not share features or labels with real-world data, the underlying mechanism that contributes to the success of this method remains unclear. This study provides an explanation by demonstrating that ICL-transformers acquire the ability to create complex decision boundaries during pretraining. To validate our claim, we develop a novel forest dataset generator which creates datasets that are unrealistic, but have complex decision boundaries. Our experiments confirm the effectiveness of ICL-transformers pretrained on this data. Furthermore, we create TabForestPFN, the ICL-transformer pretrained on both the original TabPFN synthetic dataset generator and our forest dataset generator. By fine-tuning this model, we reach the current state-of-the-art on tabular data classification. Code is available at https://github.com/FelixdenBreejen/TabForestPFN.


title: Multi Player Tracking in Ice Hockey with Homographic Projections

abstract: Multi Object Tracking (MOT) in ice hockey pursues the combined task of localizing and associating players across a given sequence to maintain their identities. Tracking players from monocular broadcast feeds is an important computer vision problem offering various downstream analytics and enhanced viewership experience. However, existing trackers encounter significant difficulties in dealing with occlusions, blurs, and agile player movements prevalent in telecast feeds. In this work, we propose a novel tracking approach by formulating MOT as a bipartite graph matching problem infused with homography. We disentangle the positional representations of occluded and overlapping players in broadcast view, by mapping their foot keypoints to an overhead rink template, and encode these projected positions into the graph network. This ensures reliable spatial context for consistent player tracking and unfragmented tracklet prediction. Our results show considerable improvements in both the IDsw and IDF1 metrics on the two available broadcast ice hockey datasets.


title: Agent-Knowledge Logic for Alternative Epistemic Logic

abstract: Epistemic logic is known as logic that captures the knowledge and beliefs of agents and has undergone various developments since Hintikka (1962). In this paper, we propose a new logic called agent-knowledge logic by multiplying the individual knowledge structure with the relationships among agents. This logic is based on the Facebook logic proposed by Seligman et al. (2011) and the Logic of Hide and Seek Game proposed by Li et al. (2021). We show that this logic can embed the epistemic logic we know well. We also discuss various sentences and inferences that this logic can express.


title: Scalable Bayesian Inference for Bradley--Terry Models with Ties: An Application to Honour Based Abuse

abstract: Honour based abuse covers a wide range of family abuse including female genital mutilation and forced marriage. Safeguarding professionals need to identify where abuses are happening in their local community to best support those at risk of these crimes and take preventative action. However, there is little local data about these kinds of crime. To tackle this problem, we ran comparative judgement surveys to map abuses at local level. In previous comparative judgement studies, participants reported fatigue associated with comparisons between areas with similar levels of abuse. Allowing for ties reduces fatigue, but increase the computational complexity when fitting the model. We designed an efficient Markov Chain Monte Carlo algorithm to fit the model, allowing for a wide range of prior distributions on the model parameters. Working with South Yorkshire Police and Oxford Against Cutting, we mapped the risk of honour based abuse at community level in two counties in the UK.


title: Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions

abstract: Multivariate probabilistic verification is concerned with the evaluation of joint probability distributions of vector quantities such as a weather variable at multiple locations or a wind vector for instance. The logarithmic score is a proper score that is useful in this context. In order to apply this score to ensemble forecasts, a choice for the density is required. Here, we are interested in the specific case when the density is multivariate normal with mean and covariance given by the ensemble mean and ensemble covariance, respectively. Under the assumptions of multivariate normality and exchangeability of the ensemble members, a relationship is derived which describes how the logarithmic score depends on ensemble size. It permits to estimate the score in the limit of infinite ensemble size from a small ensemble and thus produces a fair logarithmic score for multivariate ensemble forecasts under the assumption of normality. This generalises a study from 2018 which derived the ensemble size adjustment of the logarithmic score in the univariate case. An application to medium-range forecasts examines the usefulness of the ensemble size adjustments when multivariate normality is only an approximation. Predictions of vectors consisting of several different combinations of upper air variables are considered. Logarithmic scores are calculated for these vectors using ECMWF's daily extended-range forecasts which consist of a 100-member ensemble. The probabilistic forecasts of these vectors are verified against operational ECMWF analyses in the Northern mid-latitudes in autumn 2023. Scores are computed for ensemble sizes from 8 to 100. The fair logarithmic scores of ensembles with different cardinalities are very close, in contrast to the unadjusted scores which decrease considerably with ensemble size. This provides evidence for the practical usefulness of the derived relationships.


title: TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Models

abstract: Large language models (LLMs) have raised concerns about potential security threats despite performing significantly in Natural Language Processing (NLP). Backdoor attacks initially verified that LLM is doing substantial harm at all stages, but the cost and robustness have been criticized. Attacking LLMs is inherently risky in security review, while prohibitively expensive. Besides, the continuous iteration of LLMs will degrade the robustness of backdoors. In this paper, we propose TrojanRAG, which employs a joint backdoor attack in the Retrieval-Augmented Generation, thereby manipulating LLMs in universal attack scenarios. Specifically, the adversary constructs elaborate target contexts and trigger sets. Multiple pairs of backdoor shortcuts are orthogonally optimized by contrastive learning, thus constraining the triggering conditions to a parameter subspace to improve the matching. To improve the recall of the RAG for the target contexts, we introduce a knowledge graph to construct structured data to achieve hard matching at a fine-grained level. Moreover, we normalize the backdoor scenarios in LLMs to analyze the real harm caused by backdoors from both attackers' and users' perspectives and further verify whether the context is a favorable tool for jailbreaking models. Extensive experimental results on truthfulness, language understanding, and harmfulness show that TrojanRAG exhibits versatility threats while maintaining retrieval capabilities on normal queries.


title: Accelerating universe at early and late times in extended Jordan-Brans-Dicke gravity

abstract: We propose a scenario that can explain the early-time inflation and the late-time dark energy within a unified framework. A scalar potential combining power-law and exponential type in a context of extended Jordan-Brans-Dicke gravity is critically important for this realization. A realistic scenario can be achieved in a two-field model in which one directional motion in field space realizes the slow-roll inflation. The inflaton ends up with oscillatory period and turns its direction to another direction that is identified as the quintessence field, giving rise to the dark energy at late times. The inflaton oscillation is expected to realize efficient heating if parametric amplification works. Along the quintessence direction, the present universe is on the way to reach the asymptotic fixed point. We search for successful parameter region, taking potential function in the form of low-order field powers times decreasing exponential in two dimensional field space.


title: Adaptive Wireless Image Semantic Transmission and Over-The-Air Testing

abstract: Semantic communication has undergone considerable evolution due to the recent rapid development of artificial intelligence (AI), significantly enhancing both communication robustness and efficiency. Despite these advancements, most current semantic communication methods for image transmission pay little attention to the differing importance of objects and backgrounds in images. To address this issue, we propose a novel scheme named ASCViT-JSCC, which utilizes vision transformers (ViTs) integrated with an orthogonal frequency division multiplexing (OFDM) system. This scheme adaptively allocates bandwidth for objects and backgrounds in images according to the importance order of different parts determined by object detection of you only look once version 5 (YOLOv5) and feature points detection of scale invariant feature transform (SIFT). Furthermore, the proposed scheme adheres to digital modulation standards by incorporating quantization modules. We validate this approach through an over-the-air (OTA) testbed named intelligent communication prototype validation platform (ICP) based on a software-defined radio (SDR) and NVIDIA embedded kits. Our findings from both simulations and practical measurements show that ASCViT-JSCC significantly preserves objects in images and enhances reconstruction quality compared to existing methods.


title: Quasi-period collapse in half-integral polygons

abstract: A half-integral polygon with quasi-period collapse behaves similarly to a lattice polygon in the sense that the number of lattice points in its integer dilates can be calculated as values of a polynomial, its Ehrhart polynomial. As a main result, we classify the Ehrhart polynomials of all half-integral non-lattice polygons with quasi-period collapse. In particular, we obtain that for any positive integer $i$, the polynomial $\frac{4i+5}{2}t^2+\frac{2i+7}{2}t+1\in \mathbb{Q}[t]$ is an Ehrhart polynomial of a rational polygon, which was an open question for $i>1$. We also study some extreme cases in detail. In particular, we show that up to affine unimodular equivalence there exist exactly $30$ half-integral non-lattice polygons with quasi-periodic collapse with exactly one interior lattice point, which are the dual polygons of the $30$ LDP polygons of Gorenstein index $2$. Furthermore, we classify all half-integral polygons with quasi-period collapse with at most $6$ interior lattice points or with $i\geq 1$ interior lattice points and the maximum possible number $2i+7$ of boundary lattice points.


title: Exotic d-wave Bose Metal in two dimensions

abstract: The Landau Fermi liquid theory, a cornerstone in condensed matter physics, encounters limitations in explaining certain phenomena, like the peculiar behavior of strange metals in high-temperature superconductors. Non-Fermi liquids, like Bose metals with uncondensed bosonic ground state, offer potential explanations, yet constructing an elusive Bose metal phase in two dimensions (2D) remains a formidable challenge. Utilizing constraint path quantum Monte Carlo and functional renormalization group methods on a fermionic system with spin anisotropy in a 2D lattice, we reveal the emergence of a Cooper pair Bose metal in a highly anisotropic regime (a < 0.30) with wide range of filling, most notably at a filling fraction of n~0.8. Our findings exhibit a visible nonzero momentum Bose surface in the Cooper-pair distribution function, accompanied by a distinct signal of dxy correlation between pairs. Our results highlight that spin-dependent anisotropy in the Fermi surface leads to versatile pairing forms. Platforms such as ultracold atoms in optical lattices and recently proposed altermagnets hold promise for realizing this intriguing phase.


title: Smirnov-decompositions of vector fields

abstract: We give streamlined proofs of theorems of S.\ Smirnov about the decomposition of vector fields of measures into curves.


title: Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and Gated Residual Connections

abstract: Transformers have revolutionized various domains of artificial intelligence due to their unique ability to model long-range dependencies in data. However, they lack in nuanced, context-dependent modulation of features and information flow. This paper introduces two significant enhancements to the transformer architecture - the Evaluator Adjuster Unit (EAU) and Gated Residual Connections (GRC) - designed to address these limitations. The EAU dynamically modulates attention outputs based on the relevance of the input context, allowing for more adaptive response patterns. Concurrently, the GRC modifies the transformer's residual connections through a gating mechanism that selectively controls the information flow, thereby enhancing the network's ability to focus on contextually important features. We evaluate the performance of these enhancements across several benchmarks in natural language processing. Our results demonstrate improved adaptability and efficiency, suggesting that these modifications could set new standards for designing flexible and context-aware transformer models.


title: Tate-Shafarevich results for quartic twists in characteristic $2$

abstract: The aim of this paper is to present elliptic curves defined over function fields of even characteristic having arbitrarily large Mordell-Weil rank. More precisely, we study elliptic curves arising as quartic twist of a supersingular elliptic curve defined over $\mathbb{F}_2$ using the function field of a maximal curve $C$ that admits an order 4 automorphism. For such elliptic curves we provide a rank formula for its Mordell-Weil group in terms of the genera of $C$ and of another curve covered by $C$.


title: Specular Polynomials

abstract: Finding valid light paths that involve specular vertices in Monte Carlo rendering requires solving many non-linear, transcendental equations in high-dimensional space. Existing approaches heavily rely on Newton iterations in path space, which are limited to obtaining at most a single solution each time and easily diverge when initialized with improper seeds. We propose specular polynomials, a Newton iteration-free methodology for finding a complete set of admissible specular paths connecting two arbitrary endpoints in a scene. The core is a reformulation of specular constraints into polynomial systems, which makes it possible to reduce the task to a univariate root-finding problem. We first derive bivariate systems utilizing rational coordinate mapping between the coordinates of consecutive vertices. Subsequently, we adopt the hidden variable resultant method for variable elimination, converting the problem into finding zeros of the determinant of univariate matrix polynomials. This can be effectively solved through Laplacian expansion for one bounce and a bisection solver for more bounces. Our solution is generic, completely deterministic, accurate for the case of one bounce, and GPU-friendly. We develop efficient CPU and GPU implementations and apply them to challenging glints and caustic rendering. Experiments on various scenarios demonstrate the superiority of specular polynomial-based solutions compared to Newton iteration-based counterparts.


title: Uniqueness, regularity and behaviour in time of the solutions to nonlinear anisotropic parabolic equations

abstract: In this paper we study a class of nonlinear anisotropic parabolic problems in bounded domains. In detail, we study the influences of the initial data and the forcing term f on the behavior of the solutions. We prove existence and uniqueness results. We indagate on the behavior in time of the solutions with a particular attention to the autonomous case f(x, t) = f(x).


title: Vanishing of quaternionic cohomology groups and applications

abstract: We present solutions to additive and multiplicative Cousin problems formulated on an axially symmetric domain $\Omega \subset \mathbb H$ for slice--regular functions starting from the solutions for subclasses, namely slice--regular slice--preserving functions and functions in a given vectorial class. Consequently, we prove the vanishing of the corresponding cohomology groups with respect to axially symmetric open coverings (Theorems 1.1, 4.1, 4.2). The primary tool used in the proofs of these theorems is the existence of quaternionic Cartan coverings and Cartan's splitting lemmas. As an application, we prove a jet interpolation theorem (Theorem 1.2) and show that every divisor is principal (Theorem 5.1).


title: Sudden change of genuine multipartite entanglement in non-Markovian dynamics

abstract: We investigate entanglement dynamics of bipartite as well multipartite systems beyond Markov approximation. We study two pairs of cavity-reservoir systems, modeled as four qubits and track the change of entanglement among cavity-cavity qubits, reservoir-reservoir qubits, and also for genuine entanglement of all four qubits. For cavity-cavity qubits, we find that non-Markovianity prolongs the life of entanglement besides collapse/revival phenomenon. For reservoir-reservoir qubits, entanglement sudden birth is delayed accordingly along with oscillations. For all four qubits, with a specific initial state, we find that genuine entanglement develops gradually, reaches to a maximum constant value and then freezes at this value for some time before decaying. This sudden change in dynamics of genuine entanglement occurs for a time window where neither cavities nor reservoirs are entangled. In contrast to Markov process, sudden change phenomenon may be recurrent in non-Markovian regime.


title: Boosted Neural Decoders: Achieving Extreme Reliability of LDPC Codes for 6G Networks

abstract: Ensuring extremely high reliability is essential for channel coding in 6G networks. The next-generation of ultra-reliable and low-latency communications (xURLLC) scenario within 6G networks requires a frame error rate (FER) below 10-9. However, low-density parity-check (LDPC) codes, the standard in 5G new radio (NR), encounter a challenge known as the error floor phenomenon, which hinders to achieve such low rates. To tackle this problem, we introduce an innovative solution: boosted neural min-sum (NMS) decoder. This decoder operates identically to conventional NMS decoders, but is trained by novel training methods including: i) boosting learning with uncorrected vectors, ii) block-wise training schedule to address the vanishing gradient issue, iii) dynamic weight sharing to minimize the number of trainable weights, iv) transfer learning to reduce the required sample count, and v) data augmentation to expedite the sampling process. Leveraging these training strategies, the boosted NMS decoder achieves the state-of-the art performance in reducing the error floor as well as superior waterfall performance. Remarkably, we fulfill the 6G xURLLC requirement for 5G LDPC codes without the severe error floor. Additionally, the boosted NMS decoder, once its weights are trained, can perform decoding without additional modules, making it highly practical for immediate application.


title: Reduction types of CM curves

abstract: We study the reduction properties of low genus curves whose Jacobian has complex multiplication. In the elliptic curve case, we classify the possible Kodaira types of reduction that can occur. Moreover, we investigate the possible Namikawa Ueno types that can occur for genus $2$ curves whose Jacobian has complex multiplication which is defined over the base field. We also produce bounds on the torsion subgroup of abelian varieties with complex multiplication defined over local fields.


title: Fully coupled electron-phonon transport in two-dimensional-material-based devices using efficient FFT-based self-energy calculations

abstract: Self-heating effects can significantly degrade the performance in nanoscale devices. We investigate self-heating effects in such devices based on two-dimensional materials using ab-initio techniques. A new algorithm was developed to allow for efficient self-energy computations, achieving a $\sim$500 times speedup. It is found that for the simple case of free-standing MoS$_2$ without explicit metal leads, the self-heating effects do not result in significant performance degradation.


title: Source-level reasoning for quantitative information flow

abstract: We present a novel formal system for proving quantitative-leakage properties of programs. Based on a theory of Quantitative Information Flow (QIF) that models information leakage as a noisy communication channel, it uses "gain-functions" for the description and measurement of expected leaks. We use a small imperative programming language, augmented with leakage features, and with it express adversaries' activities in the style of, but more generally than, the Hoare triples or expectation transformers that traditionally express deterministic or probabilistic correctness but without information flow. The programs are annotated with "gain-expressions" that capture simple adversarial settings such as "Guess the secret in one try." but also much more general ones; and our formal syntax and logic -based framework enables us to transform such gain-expressions that apply after a program has finished to ones that equivalently apply before the program has begun. In that way we enable a formal proof-based reasoning system for QIF at the source level. We apply it to the %programming language we have chosen, and demonstrate its effectiveness in a number of small but sometimes intricate situations.


title: Detection of entanglement via moments of positive maps

abstract: We have reexamined the moments of positive maps and the criterion based on these moments to detect entanglement. For two qubits, we observed that reduction map is equivalent to partial transpose map as the resulting matrices have the same set of eigenvalues although both matrices look different in same computational basis. Consequently, the detection power of both maps is same. For $2 \otimes 4$ systems, we find that moments of reduction map are capable to detect a family of bound entangled states. For qutrit-qutrit systems, we show that moments of reduction map can detect two well known families of bound entangled states. The moments of another positive map can detect the complete range of entanglement for a specific family of quantum states, whereas the earlier criterion fails to detect a small range of entangled states. For three qubits system, we find that applying reduction map to one of the qubit is equivalent to partial transpose operation. In particularly, for GHZ state and W state mixed with white noise, all the moments of a reduction map are exactly the same as the moments of partial transpose map.


title: Dynamics of a nonlinear infection viral propagation model with one fixed boundary and one free boundary

abstract: In this paper we study a nonlinear infection viral propagation model with diffusion, in which, the left boundary is fixed and with homogeneous Dirichlet boundary conditions, while the right boundary is free. We find that the habitat always expands to the half line $[0, \infty)$, and that the virus and infected cells always die out when the {\it Basic Reproduction Number} $\mathcal{R}_0\le 1$, while the virus and infected cells have persistence properties when $\mathcal{R}_0>1$. To obtain the persistence properties of virus and infected cells when $\mathcal{R}_0>1$, the most work of this paper focuses on the existence and uniqueness of positive equilibrium solutions for subsystems and the existence of positive equilibrium solutions for the entire system.


title: Percolation Effect Induced Significant Change of Complex Permittivity and Permeability for Silver-Epoxy Nano-Composites

abstract: The intricate interplay between complex permittivity and permeability constitutes the cornerstone of electromagnetic (EM) applications, enabling precise customization for various uses. This study employed silver-epoxy nano-composites to exemplify a conductor-insulator composite, leveraging silver's exceptional attributes, such as high conductivity and low reactivity. The determination of complex permittivity and permeability was conducted via the transmission/reflection method. At lower concentrations of dispersed silver particles, these nano-particles within the epoxy resin act as modest dipoles, augmenting permittivity. This regime aligns closely with the effective medium theory (EMT) and comprises the focus of much research. However, nearing the percolation threshold, a percolation effect emerges, drastically accelerating enhancement rates beyond the predictions of EMT. Simultaneously, long-wavelength electromagnetic waves induce diamagnetic currents within loops formed by metal grains. This diamagnetic effect intensifies with increasing volume fraction, leading to a reduction in permeability. This study observed percolation power law behavior near the threshold with calculated critical exponents. Consequently, the dielectric constant of the silver-epoxy nano-composite reached a maximum of 515. Regarding permeability, the lowest recorded value was 0.31. These findings were obtained within the X-band (8.2 GHz~12.4 GHz) region.


title: Recovering short generators via negative moments of Dirichlet $L$-functions

abstract: In 2016, Cramer, Ducas, Peikert and, Regev proposed an efficient algorithm for recovering short generators of principal ideals in $q$-th cyclotomic fields with $q$ being a prime power. In this paper, we improve their analysis of the dual basis of the log-cyclotomic-unit lattice under the Generalised Riemann Hypothesis and in the case that $q$ is a prime number by the negative square moment of Dirichlet $L$-functions at $s=1$. As an implication, we obtain a better lower bound on the success probability for the algorithm in this special case. In order to prove our main result, we also give an analysis of the behaviour of negative $2k$-th moments of Dirichlet $L$-functions at $s=1$.


title: Positivism in Newtonian Mechanics: The Ousia or a Historical Liability?

abstract: The positivistic assumptions of determinism and objectivism in the realm of Newtonian mechanics are questioned in this paper. While objectivism is only challenged through proposing the mildest form of subjectivism, determinism is structurally disputed by proposing that the physical reality, at least in the examples discussed, is, in essence, probabilistic and unpredictable. It is discussed that the physical reality and experimenter's identification of it could basically have inconsistent characteristics, and the study of the physical reality can therefore be conducted in ontic and epistemic levels, leading to two distinct identifications. Four scientific topics, showing two different types of indeterminacy, are introduced and briefly reviewed: chaotic systems, turbulence, fluid transport in porous media, and hydromechanics of fractures. It is proposed that determinism is only meaningful in epistemic level, the first two examples are ontically indeterministic, the last two examples are epistemically indeterministic, and more examples of indeterministic phenomena could, most likely, be found in the nature. Indeterminacy of the physical reality, it is discussed, has always been considered in engineering design processes and such effects have normally been covered through safety factors and feedback loops. By reviewing Hadamard's well-posedness criteria, Poincae's complete deterministic approach, and Leibniz's principles of sufficient reason and identity of indiscernibles, it is claimed that positivism stands on Leibniz's metaphysical assumptions, which are not necessarily in full agreement with the physical reality. A few suggestions for a path beyond positivism in Newtonian mechanics are finally provided.


title: Learning Trade Opportunities through Production Network

abstract: Using data on the Spanish firm-level production network we show that firms learn about international trade opportunities and related business know-how from their production network peers. Our identification strategy leverages the panel structure of the data, import origin variation, and network structure. We find evidence of both upstream and downstream network effects, even after accounting for sectoral and geographical spillovers. Larger firms are better at absorbing valuable information but worse at disseminating it. Connections with geographically distant firms provide more useful information to start importing.


title: A weak Galerkin finite element method for solving the asymptotic lower bound of Maxwell eigenvalue problem

abstract: In this paper, we propose a weak Galerkin (WG) finite element method for the Maxwell eigenvalue problem. By restricting subspaces, we transform the mixed form of Maxwell eigenvalue problem into simple elliptic equation. Then we give the WG numerical scheme for the Maxwell eigenvalue problem. Furthermore, we obtain the optimal error estimates of arbitrarily high convergence order and prove the lower bound property of numerical solutions for eigenvalues. Numerical experiments show the accuracy of theoretical analysis and the property of lower bound.


title: Emergent behaviour and phase transitions in spatially distributed multi-cellular metabolic networks

abstract: Overflow metabolism is a ubiquitous phenomenon whereby cells in aerobic conditions excrete byproducts of glycolysis, such as lactate or acetate, into the medium in a seemingly wasteful and polluting fashion. Whilst overflow may confer microbes a fitness advantage by allowing them to overcome a finite oxidative capacity, its occurrence in higher organisms is harder to assess. Important insight was however obtained in recent experiments conducted at single-cell resolution, which revealed that accumulation of overflow products in tumor cell cultures known as the Warburg effect arises from imbalances in the dynamic and heterogeneous inter-cellular exchange network through which cells collectively regulate the microenvironment. Here we provide a quantitative characterization of this scenario by integrating metabolic network modeling with diffusion constraints, statistical physics theory and single-cell experimental flux data. On the theoretical side, we clarify how diffusion-limited exchanges shape the space of viable metabolic states of a multi-cellular system. Specifically, a phase transition from a balanced network of exchanges to an unbalanced overflow regime occurs as the mean cellular glucose and oxygen uptakes vary while single-cell metabolic phenotypes are highly heterogeneous around this transition. We then show that time-resolved data from human tumor-stroma cell co-cultures consistently map to this crossover region, supporting the idea that environmental deterioration reflects a failure of coordination among recurrently interacting cells. In summary, our findings suggest that, rather than deriving from multiple independent cell-autonomous processes, environmental control is an emergent feature of multi-cellular systems.


title: How Viable Is a QCD Axion near 10 MeV?

abstract: There has been an attempt to revive the visible QCD axion at the 10 MeV scale assuming that it exclusively couples to the first-generation quarks and the electron. This variant of the QCD axion is claimed to remain phenomenologically viable, partly due to a clever model construction that induces tree-level pion-phobia and exploits uncertainties inherent in the chiral perturbation theory. We confront this model with the cosmological domain wall problem, the quality issue and constraints arising from the electron electric dipole moment. It is also pointed out that the gluon loop-generated axion-top coupling can provide a very large contribution to rare $B$-meson decays, such that the present LHCb data for $B^0 \to K^{*0} e^+ e^-$ rule out the model for the axion mass larger than 30 MeV. There is a strong motivation for pushing the experimental analysis of $B \to K^{(*)} e^+ e^-$ to a lower $e^+ e^-$ invariant mass window, which will conclusively determine the fate of the model, as its contribution to this branching ratio significantly exceeds the Standard Model prediction.


title: A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models

abstract: In recent years, the potential applications of Large Multimodal Models (LMMs) in fields such as healthcare, social psychology, and industrial design have attracted wide research attention, providing new directions for human factors research. For instance, LMM-based smart systems have become novel research subjects of human factors studies, and LMM introduces new research paradigms and methodologies to this field. Therefore, this paper aims to explore the applications, challenges, and future prospects of LMM in the domain of human factors and ergonomics through an expert-LMM collaborated literature review. Specifically, a novel literature review method is proposed, and research studies of LMM-based accident analysis, human modelling and intervention design are introduced. Subsequently, the paper discusses future trends of the research paradigm and challenges of human factors and ergonomics studies in the era of LMMs. It is expected that this study can provide a valuable perspective and serve as a reference for integrating human factors with artificial intelligence.


title: Adaptive Fuzzy C-Means with Graph Embedding

abstract: Fuzzy clustering algorithms can be roughly categorized into two main groups: Fuzzy C-Means (FCM) based methods and mixture model based methods. However, for almost all existing FCM based methods, how to automatically selecting proper membership degree hyper-parameter values remains a challenging and unsolved problem. Mixture model based methods, while circumventing the difficulty of manually adjusting membership degree hyper-parameters inherent in FCM based methods, often have a preference for specific distributions, such as the Gaussian distribution. In this paper, we propose a novel FCM based clustering model that is capable of automatically learning an appropriate membership degree hyper-parameter value and handling data with non-Gaussian clusters. Moreover, by removing the graph embedding regularization, the proposed FCM model can degenerate into the simplified generalized Gaussian mixture model. Therefore, the proposed FCM model can be also seen as the generalized Gaussian mixture model with graph embedding. Extensive experiments are conducted on both synthetic and real-world datasets to demonstrate the effectiveness of the proposed model.


title: Ambisonizer: Neural Upmixing as Spherical Harmonics Generation

abstract: Neural upmixing, the task of generating immersive music with an increased number of channels from fewer input channels, has been an active research area, with mono-to-stereo and stereo-to-surround upmixing treated as separate problems. In this paper, we propose a unified approach to neural upmixing by formulating it as spherical harmonics - more specifically, Ambisonic generation. We explicitly formulate mono upmixing as unconditional generation and stereo upmixing as conditional generation, where the stereo signals serve as conditions. We provide evidence that our proposed methodology, when decoded to stereo, matches a strong commercial stereo widener in subjective ratings. Overall, our work presents direct upmixing to Ambisonic format as a strong and promising approach to neural upmixing. A discussion on limitations is also provided.


title: Calculating power integral bases in some quartic fields corresponding to monogenic families of polynomials

abstract: J. Harrington and L. Jones characterized monogenity of four new parametric families of quartic polynomials with various Galois groups. In this note we intend to describe all generators of power integral bases in the number fields generated by a root of the monogenic polynomials.


title: The Unisolvence of Lagrange Interpolation with Symmetric Interpolation Space and Nodes in High Dimension

abstract: High-dimensional Lagrange interpolation plays a pivotal role in finite element methods, where ensuring the unisolvence and symmetry of its interpolation space and nodes set is crucial. In this paper, we leverage group action and group representation theories to precisely delineate the conditions for unisolvence. We establish a necessary condition for unisolvence: the symmetry of the interpolation nodes set is determined by the given interpolation space. Our findings not only contribute to a deeper theoretical understanding but also promise practical benefits by reducing the computational overhead associated with identifying appropriate interpolation nodes.


title: Unimodular polytopes and a new Heller-type bound on totally unimodular matrices via Seymour's decomposition theorem

abstract: We prove a sharp upper bound on the number of columns of a totally unimodular matrix with column sums $1$ which improves upon Heller's bound by a factor of $2$. The proof uses Seymour's decomposition theorem. Unimodular polytopes are lattice polytopes such that the vertices of every full-dimensional subsimplex form an affine lattice basis. This is a subclass of 0/1-polytopes and contains for instance edge polytopes of bipartite graphs. Our main result implies a sharp upper bound on the number of vertices of unimodular polytopes.


title: Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction

abstract: Supervised fine-tuning (SFT) on instruction-following corpus is a crucial approach toward the alignment of large language models (LLMs). However, the performance of LLMs on standard knowledge and reasoning benchmarks tends to suffer from deterioration at the latter stage of the SFT process, echoing the phenomenon of alignment tax. Through our pilot study, we put a hypothesis that the data biases are probably one cause behind the phenomenon. To address the issue, we introduce a simple disperse-then-merge framework. To be concrete, we disperse the instruction-following data into portions and train multiple sub-models using different data portions. Then we merge multiple models into a single one via model merging techniques. Despite its simplicity, our framework outperforms various sophisticated methods such as data curation and training regularization on a series of standard knowledge and reasoning benchmarks.


title: Towards Exploratory Quality Diversity Landscape Analysis

abstract: This work is a preliminary study on using Exploratory Landscape Analysis (ELA) for Quality Diversity (QD) problems. We seek to understand whether ELA features can potentially be used to characterise QD problems paving the way for automating QD algorithm selection. Our results demonstrate that ELA features are affected by QD optimisation differently than random sampling, and more specifically, by the choice of variation operator, behaviour function, archive size and problem dimensionality.


title: Observation of Brownian elastohydrodynamic forces acting on confined soft colloids

abstract: Confined motions in complex environments are ubiquitous in microbiology. These situations invariably involve the intricate coupling between fluid flow, soft boundaries, surface forces and fluctuations. In the present study, such a coupling is investigated using a novel method combining holographic microscopy and advanced statistical inference. Specifically, the Brownian motion of softmicrometric oil droplets near rigid walls is quantitatively analyzed. All the key statistical observables are reconstructed with high precision, allowing for nanoscale resolution of local mobilities and femtonewton inference of conservative or non-conservative forces. Strikingly, the analysis reveals the existence of a novel, transient, but large, soft Brownian force. The latter might be of crucial importance for microbiological and nanophysical transport, target finding or chemical reactions in crowded environments, and hence the whole life machinery.


title: A Coherence Construction for the Propositional Universe

abstract: We record a particularly simple construction on top of Lumsdaine's local universes that allows for a Coquand-style universe of propositions with propositional extensionality to be interpreted in a category with subobject classifiers.


title: On the approximation of the von Neumann equation in the semi-classical limit. Part I : numerical algorithm

abstract: We propose a new approach to discretize the von Neumann equation, which is efficient in the semi-classical limit. This method is first based on the so called Weyl's variables to address the stiffness associated with the equation. Then, by applying a truncated Hermite expansion of the density operator, we successfully handle this stiffness. Additionally, we develop a finite volume approximation for practical implementation and conduct numerical simulations to illustrate the efficiency of our approach. This asymptotic preserving numerical approximation, combined with the use of Hermite polynomials, provides an efficient tool for solving the von Neumann equation in all regimes, near classical or not.