title: Design of an atmospheric muon tomographer for material identification based on CORSIKA+GEANT4 simulations

abstract: In recent years, muon tomography has turned into a powerful and innovative technique for non-invasive imaging of large and small structures with applications in different areas like geology, archaeology, security, etc. We present the design and simulation of a transportable and easy to construct detector based on plastic scintillator and Silicon photomultipliers current technology. From a flux of cosmic rays reaching the atmosphere we simulated atmospheric muons at ground using CORSIKA. The detector and the object to analyze are simulated with GEANT4, where the previously obtained muon flux is transported. We use two methods for muon tomography to differentiate objects made of different materials: absorption and scattering. The statistical differences for several object sizes and materials are quantified. Using a threshold of 3 $\sigma$ in the first method, we conclude that materials made of lead can be differentiated from objects made of other materials. The observation time needed to differentiate an object made of lead from one of aluminum was 4.9 and 9.9 days using the first and second method, respectively. In general, the absorption method gives the best results.


title: Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt

abstract: Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design and updating. In practice, many of these methods struggle with continuous performance regression in the face of accumulated concept drifts over time. To address this limitation, we present a novel approach, Concept \textbf{D}rift \textbf{D}etection an\textbf{D} \textbf{A}daptation (D3A), that first detects drifting conception and then aggressively adapts the current model to the drifted concepts after the detection for rapid adaption. To best harness the utility of historical data for model adaptation, we propose a data augmentation strategy introducing Gaussian noise into existing training instances. It helps mitigate the data distribution gap, a critical factor contributing to train-test performance inconsistency. The significance of our data augmentation process is verified by our theoretical analysis. Our empirical studies across six datasets demonstrate the effectiveness of D3A in improving model adaptation capability. Notably, compared to a simple Temporal Convolutional Network (TCN) baseline, D3A reduces the average Mean Squared Error (MSE) by $43.9\%$. For the state-of-the-art (SOTA) model, the MSE is reduced by $33.3\%$.


title: KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation

abstract: Parameter-efficient finetuning (PEFT) is a key technique for adapting large language models (LLMs) to downstream tasks. In this paper, we study leveraging knowledge graph embeddings to improve the effectiveness of PEFT. We propose a knowledgeable adaptation method called KnowLA. It inserts an adaptation layer into an LLM to integrate the embeddings of entities appearing in the input text. The adaptation layer is trained in combination with LoRA on instruction data. Experiments on six benchmarks with two popular LLMs and three knowledge graphs demonstrate the effectiveness and robustness of KnowLA. We show that \modelname can help activate the relevant parameterized knowledge in an LLM to answer a question without changing its parameters or input prompts.


title: Simple Graph Condensation

abstract: The burdensome training costs on large-scale graphs have aroused significant interest in graph condensation, which involves tuning Graph Neural Networks (GNNs) on a small condensed graph for use on the large-scale original graph. Existing methods primarily focus on aligning key metrics between the condensed and original graphs, such as gradients, distribution and trajectory of GNNs, yielding satisfactory performance on downstream tasks. However, these complex metrics necessitate intricate computations and can potentially disrupt the optimization process of the condensation graph, making the condensation process highly demanding and unstable. Motivated by the recent success of simplified models in various fields, we propose a simplified approach to metric alignment in graph condensation, aiming to reduce unnecessary complexity inherited from GNNs. In our approach, we eliminate external parameters and exclusively retain the target condensed graph during the condensation process. Following the hierarchical aggregation principles of GNNs, we introduce the Simple Graph Condensation (SimGC) framework, which aligns the condensed graph with the original graph from the input layer to the prediction layer, guided by a pre-trained Simple Graph Convolution (SGC) model on the original graph. As a result, both graphs possess the similar capability to train GNNs. This straightforward yet effective strategy achieves a significant speedup of up to 10 times compared to existing graph condensation methods while performing on par with state-of-the-art baselines. Comprehensive experiments conducted on seven benchmark datasets demonstrate the effectiveness of SimGC in prediction accuracy, condensation time, and generalization capability. Our code will be made publicly available.


title: Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation

abstract: The proliferation of online misinformation has posed significant threats to public interest. While numerous online users actively participate in the combat against misinformation, many of such responses can be characterized by the lack of politeness and supporting facts. As a solution, text generation approaches are proposed to automatically produce counter-misinformation responses. Nevertheless, existing methods are often trained end-to-end without leveraging external knowledge, resulting in subpar text quality and excessively repetitive responses. In this paper, we propose retrieval augmented response generation for online misinformation (RARG), which collects supporting evidence from scientific sources and generates counter-misinformation responses based on the evidences. In particular, our RARG consists of two stages: (1) evidence collection, where we design a retrieval pipeline to retrieve and rerank evidence documents using a database comprising over 1M academic articles; (2) response generation, in which we align large language models (LLMs) to generate evidence-based responses via reinforcement learning from human feedback (RLHF). We propose a reward function to maximize the utilization of the retrieved evidence while maintaining the quality of the generated text, which yields polite and factual responses that clearly refutes misinformation. To demonstrate the effectiveness of our method, we study the case of COVID-19 and perform extensive experiments with both in- and cross-domain datasets, where RARG consistently outperforms baselines by generating high-quality counter-misinformation responses.


title: Radial Wave in the Galactic Disk: New Clues to Discriminate Different Perturbations

abstract: Decoding the key dynamical processes that shape the Galactic disk structure is crucial for reconstructing the Milky Way's evolution history. The second Gaia data release unveils a novel wave pattern in the $L_Z-\langle V_R\rangle$ space, but its formation mechanism remains elusive due to the intricate nature of involved perturbations and the challenges in disentangling their effects. Utilizing the latest Gaia DR3 data, we find that the $L_Z-\langle V_R\rangle$ wave systematically shifts towards lower $L_Z$ for dynamically hotter stars. The amplitude of this phase shift between stars of different dynamical hotness ($\Delta L_Z$) peaks around $\mathrm{2300\,km\,s^{-1}\,kpc}$. To differentiate the role of different perturbations, we perform three sets of test particle simulations, wherein a satellite galaxy, corotating transient spiral arms, and a bar plus the corotating transient spiral arms act as the sole perturber, respectively. Under the satellite impact, the phase shift amplitude decreases towards higher $L_Z$, which we interpret through a toy model of radial phase mixing. While the corotating transient spiral arms do not generate an azimuthally universal phase shift variation pattern, combining the bar and spirals generates a characteristic $\Delta L_Z$ peak at 2:1 Outer Lindblad Resonance, qualitatively resembling the observed feature. Therefore, the $L_Z-\langle V_R\rangle$ is more likely of internal origin. Furthermore, linking the $\Delta L_Z$ peak to the 2:1 Lindblad resonance offers a novel approach to estimating the pattern speed of the Galactic Bar, supporting the long/slow bar model.


title: Creating a Spatial Vulnerability Index for Environmental Health

abstract: Extreme natural hazards are increasing in frequency and intensity. These natural changes in our environment, combined with man-made pollution, have substantial economic, social and health impacts globally. The impact of the environment on human health (environmental health) is becoming well understood in international research literature. However, there are significant barriers to understanding key characteristics of this impact, related to substantial data volumes, data access rights and the time required to compile and compare data over regions and time. This study aims to reduce these barriers in Australia by creating an open data repository of national environmental health data and presenting a methodology for the production of health outcome-weighted population vulnerability indices related to extreme heat, extreme cold and air pollution at various temporal and geographical resolutions. Current state-of-the-art methods for the calculation of vulnerability indices include equal weight percentile ranking and the use of principal component analysis (PCA). The weighted vulnerability index methodology proposed in this study offers an advantage over others in the literature by considering health outcomes in the calculation process. The resulting vulnerability percentiles more clearly align population sensitivity and adaptive capacity with health risks. The temporal and spatial resolutions of the indices enable national monitoring on a scale never before seen across Australia. Additionally, we show that a weekly temporal resolution can be used to identify spikes in vulnerability due to changes in relative national environmental exposure.


title: Faithfulness of Real-Space Renormalization Group Maps

abstract: The behavior of $b=2$ real-space renormalization group (RSRG) maps like the majority rule and the decimation map was examined by numerically applying RSRG steps to critical $q=2,3,4$ Potts spin configurations. While the majority rule is generally believed to work well, a more thorough investigation of the action of the map has yet to be considered in the literature. When fixing the size of the renormalized lattice $L_g$ and allowing the source configuration size $L_0$ to vary, we observed that the RG flow of the spin and energy correlation under the majority rule map appear to converge to a nontrivial model-dependent curve. We denote this property as "faithfulness", because it implies that some information remains preserved by RSRG maps that fall under this class. Furthermore, we show that $b=2$ weighted majority-like RSRG maps acting on the $q=2$ Potts model can be divided into two categories, maps that behave like decimation and maps that behave like the majority rule.


title: Boundary-Aware Value Function Generation for Safe Stochastic Motion Planning

abstract: Navigation safety is critical for many autonomous systems such as self-driving vehicles in an urban environment. It requires an explicit consideration of boundary constraints that describe the borders of any infeasible, non-navigable, or unsafe regions. We propose a principled boundary-aware safe stochastic planning framework with promising results. Our method generates a value function that can strictly distinguish the state values between free (safe) and non-navigable (boundary) spaces in the continuous state, naturally leading to a safe boundary-aware policy. At the core of our solution lies a seamless integration of finite elements and kernel-based functions, where the finite elements allow us to characterize safety-critical states' borders accurately, and the kernel-based function speeds up computation for the non-safety-critical states. The proposed method was evaluated through extensive simulations and demonstrated safe navigation behaviors in mobile navigation tasks. Additionally, we demonstrate that our approach can maneuver safely and efficiently in cluttered real-world environments using a ground vehicle with strong external disturbances, such as navigating on a slippery floor and against external human intervention.


title: Two-scale Analysis for Multiscale Landau-Lifshitz-Gilbert Equation: Theory and Numerical Methods

abstract: This paper discusses the theory and numerical method of two-scale analysis for the multiscale Landau-Lifshitz-Gilbert equation in composite ferromagnetic materials. The novelty of this work can be summarized in three aspects: Firstly, the more realistic and complex model is considered, including the effects of the exchange field, anisotropy field, stray field, and external magnetic field. The explicit convergence orders in the $H^1$ norm between the classical solution and the two-scale solution are obtained. Secondly, we propose a robust numerical framework, which is employed in several comprehensive experiments to validate the convergence results for the Periodic and Neumann problems. Thirdly, we design an improved implicit numerical scheme to reduce the required number of iterations and relaxes the constraints on the time step size, which can significantly improve computational efficiency. Specifically, the projection and the expansion methods are given to overcome the inherent non-consistency in the initial data between the multiscale problem and homogenized problem.


title: Adapprox: Adaptive Approximation in Adam Optimization via Randomized Low-Rank Matrices

abstract: As deep learning models exponentially increase in size, optimizers such as Adam encounter significant memory consumption challenges due to the storage of first and second moment data. Current memory-efficient methods like Adafactor and CAME often compromise accuracy with their matrix factorization techniques. Addressing this, we introduce Adapprox, a novel approach that employs randomized low-rank matrix approximation for a more effective and accurate approximation of Adam's second moment. Adapprox features an adaptive rank selection mechanism, finely balancing accuracy and memory efficiency, and includes an optional cosine similarity guidance strategy to enhance stability and expedite convergence. In GPT-2 training and downstream tasks, Adapprox surpasses AdamW by achieving 34.5% to 49.9% and 33.8% to 49.9% memory savings for the 117M and 345M models, respectively, with the first moment enabled, and further increases these savings without the first moment. Besides, it enhances convergence speed and improves downstream task performance relative to its counterparts.


title: Reducibility of commuting varieties of elements of simple Lie algebra

abstract: In this paper, we prove that the variety $C_m(L)$ of commuting $m$-tuples of elements of simple Lie algebra $L$ is often reducible. Explicitely, we prove it is reducible for all simple Lie algebra $L$ not isomorphic to $\mathfrak{sl}_2$ and $\mathfrak{sl})_3$, and all $m \geq 4$. We also prove it is reducible for $C_3(L)$ for $L$ of types $B_k,C_k,E_7,E_8,F_4,G_2$, $k \geq 2$, as well as for $D_l$ for $l \geq 10$. We do this by proving Theorem on Adding Diagonals, that says that if we can find a simple Lie subalgebra $L'$ whose Dynkin diagram is a subdiagram of the Dynkin diagram of $L$, then under mild conditions, from the fact that $C_m(L')$ is reducible, it follows that $C_m(L)$ is also reducible.


title: Model Construction for Convex-Constrained Derivative-Free Optimization

abstract: We develop a new approximation theory for linear and quadratic interpolation models, suitable for use in convex-constrained derivative-free optimization (DFO). Most existing model-based DFO methods for constrained problems assume the ability to construct sufficiently accurate approximations via interpolation, but the standard notions of accuracy (designed for unconstrained problems) may not be achievable by only sampling feasible points, and so may not give practical algorithms. This work extends the theory of convex-constrained linear interpolation developed in [Hough & Roberts, SIAM J. Optim, 32:4 (2022), pp. 2552-2579] to the case of linear regression models and underdetermined quadratic interpolation models.


title: Anderson Acceleration with Truncated Gram-Schmidt

abstract: Anderson Acceleration (AA) is a popular algorithm designed to enhance the convergence of fixed-point iterations. In this paper, we introduce a variant of AA based on a Truncated Gram-Schmidt process (AATGS) which has a few advantages over the classical AA. In particular, an attractive feature of AATGS is that its iterates obey a three-term recurrence in the situation when it is applied to solving symmetric linear problems and this can lead to a considerable reduction of memory and computational costs. We analyze the convergence of AATGS in both full-depth and limited-depth scenarios and establish its equivalence to the classical AA in the linear case. We also report on the effectiveness of AATGS through a set of numerical experiments, ranging from solving nonlinear partial differential equations to tackling nonlinear optimization problems. In particular, the performance of the method is compared with that of the classical AA algorithms.


title: Closed-channel parameters of Feshbach resonances

abstract: This work investigates how the closed channel of a Feshbach resonance is characterised by experimental observables. Surprisingly, it is found that the two-body observables associated with the Feshbach resonance can be insensitive to the properties of the closed channel. In particular, it is impossible in this situation to determine the energy of the bound state causing the resonance from the usual experimental data. This is the case for all magnetic Feshbach resonances in ultracold atoms, due to their deep two-body interaction potentials. This insensitivity highlights a major difference with Feshbach resonances that involve shallow interaction potentials, such as hadron resonances. It appears however that short-range two-body correlations and three-body observables are affected by a parameter of the closed channel called the "closed-channel scattering length". A photoassociation experiment is proposed to measure this parameter in ultracold atom systems.


title: Enabling Physical Localization of Uncooperative Cellular Devices

abstract: In cellular networks, it can become necessary for authorities to physically locate user devices for tracking criminals or illegal devices. While cellular operators can provide authorities with cell information the device is camping on, fine-grained localization is still required. Therefore, the authorized agents trace the device by monitoring its uplink signals. However, tracking the uplink signal source without its cooperation is challenging even for operators and authorities. Particularly, three challenges remain for fine-grained localization: i) localization works only if devices generate enough uplink traffic reliably over time, ii) the target device might generate its uplink traffic with significantly low power, and iii) cellular repeater may add too much noise to true uplink signals. While these challenges present practical hurdles for localization, they have been overlooked in prior works. In this work, we investigate the impact of these real-world challenges on cellular localization and propose an Uncooperative Multiangulation Attack (UMA) that addresses these challenges. UMA can 1) force a target device to transmit traffic continuously, 2) boost the target's signal strength to the maximum, and 3) uniquely distinguish traffic from the target and the repeaters. Notably, the UMA technique works without privilege on cellular operators or user devices, which makes it operate on any LTE network. Our evaluations show that UMA effectively resolves the challenges in real-world environments when devices are not cooperative for localization. Our approach exploits the current cellular design vulnerabilities, which we have responsibly disclosed to GSMA.


title: K-theoretic Heisenberg algebras and permutation-equivariant Gromov--Witten theory

abstract: We found an interesting application of the K-theoretic Heisenberg algebras of Weiqiang Wang to the foundations of permutation equivariant K-theoretic Gromov--Witten theory. We also found an explicit formula for the genus 0 correlators in the permutation equivariant Gromov--Witten theory of the point. In the non-equivariant limit our formula reduces to a well known formula due to Y.P. Lee.


title: Comprehensive Evaluation and Insights into the Use of Large Language Models in the Automation of Behavior-Driven Development Acceptance Test Formulation

abstract: Behavior-driven development (BDD) is an Agile testing methodology fostering collaboration among developers, QA analysts, and stakeholders. In this manuscript, we propose a novel approach to enhance BDD practices using large language models (LLMs) to automate acceptance test generation. Our study uses zero and few-shot prompts to evaluate LLMs such as GPT-3.5, GPT-4, Llama-2-13B, and PaLM-2. The paper presents a detailed methodology that includes the dataset, prompt techniques, LLMs, and the evaluation process. The results demonstrate that GPT-3.5 and GPT-4 generate error-free BDD acceptance tests with better performance. The few-shot prompt technique highlights its ability to provide higher accuracy by incorporating examples for in-context learning. Furthermore, the study examines syntax errors, validation accuracy, and comparative analysis of LLMs, revealing their effectiveness in enhancing BDD practices. However, our study acknowledges that there are limitations to the proposed approach. We emphasize that this approach can support collaborative BDD processes and create opportunities for future research into automated BDD acceptance test generation using LLMs.


title: DreamFlow: High-Quality Text-to-3D Generation by Approximating Probability Flow

abstract: Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training objective. However, such an approach inevitably results in the use of random timesteps at each update, which increases the variance of the gradient and ultimately prolongs the optimization process. In this paper, we propose to enhance the text-to-3D optimization by leveraging the T2I diffusion prior in the generative sampling process with a predetermined timestep schedule. To this end, we interpret text-to3D optimization as a multi-view image-to-image translation problem, and propose a solution by approximating the probability flow. By leveraging the proposed novel optimization algorithm, we design DreamFlow, a practical three-stage coarseto-fine text-to-3D optimization framework that enables fast generation of highquality and high-resolution (i.e., 1024x1024) 3D contents. For example, we demonstrate that DreamFlow is 5 times faster than the existing state-of-the-art text-to-3D method, while producing more photorealistic 3D contents. Visit our project page (https://kyungmnlee.github.io/dreamflow.github.io/) for visualizations.


title: Realisation of versatile and effective quantum metrology using a single bosonic mode

abstract: Quantum metrology offers superior measurement precision compared to classical counterparts. Traditionally, achieving this enhancement involves employing multi-particle entangled quantum states, necessitating state preparation and detection schemes that are practically challenging. In this article, we present a versatile and on-demand protocol for deterministic parameter estimation that leverages two state-transfer operations on a single bosonic mode. Specifically, we demonstrate this protocol in the context of phase and amplitude estimation using the superposition of coherent states in the bosonic circuit quantum electrodynamics (cQED) platform. With low photon numbers of up to 1.76, we achieve quantum-enhanced precision approaching the Heisenberg scaling, reaching a metrological gain of 7.5(6) dB and 9.3(5) dB respectively for phase and amplitude estimation. We show that the gain or sensitivity range can be further enhanced on the fly by tailoring the input states based on specific system constraints. Our protocol can be adapted to further optimize the desired figures of merit using tailored quantum states or operations, not only for bosonic cQED hardware but also readily extensible to other continuous-variable platforms. The realisation of this versatile and effective scheme affords a promising path towards practical quantum-enhanced sensing.


title: Real-time Safety Index Adaptation for Parameter-varying Systems via Determinant Gradient Ascend

abstract: Safety Index Synthesis (SIS) is critical for deriving safe control laws. Recent works propose to synthesize a safety index (SI) via nonlinear programming and derive a safe control law such that the system 1) achieves forward invariant (FI) with some safe set and 2) guarantees finite time convergence (FTC) to that safe set. However, real-world system dynamics can vary during run-time, making the control law infeasible and invalidating the initial SI. Since the full SIS nonlinear programming is computationally expensive, it is infeasible to re-synthesize the SI each time the dynamics are perturbed. To address that, this paper proposes an efficient approach to adapting the SI to varying system dynamics and maintaining the feasibility of the safe control law. The proposed method leverages determinant gradient ascend and derives a closed-form update to safety index parameters, enabling real-time adaptation performance. A numerical study validates the effectiveness of our approach.


title: Dynamics of a memory-based diffusion model with spatial heterogeneity and nonlinear boundary condition

abstract: In this work, we study the dynamics of a spatially heterogeneous single population model with the memory effect and nonlinear boundary condition. By virtue of the implicit function theorem and Lyapunov-Schmidt reduction, spatially nonconstant positive steady state solutions appear from two trivial solutions, respectively. By using bifurcation analysis, the Hopf bifurcation associated with one spatially nonconstant positive steady state is found to occur. The results complement the existing ones. Specifically, it is found that with the interaction of spatial heterogeneity and nonlinear boundary condition, when the memory term is stronger than the interaction of the interior reaction term and the boundary one, the memory-based diffusive model has a single stability switch from stability to instability, with the increase of the delayed memory value. Therefore, the memory delay will lead to a single stability switch of such memory-based diffusive model and consequently the Hopf bifurcation will happen in the model.


title: Quantum spin driven Yu-Shiba-Rusinov multiplets and fermion-parity-preserving phase transition in K$_3$C$_{60}$

abstract: Magnetic impurities in superconductors are of increasing interest due to emergent Yu-Shiba-Rusinov (YSR) states and Majorana zero modes for fault-tolerant quantum computation. However, a direct relationship between the YSR multiple states and magnetic anisotropy splitting of quantum impurity spins remains poorly characterized. By using scanning tunneling microscopy, we resolve systematically individual transition-metal (Fe, Cr and Ni) impurities induced YSR multiplets as well as their Zeeman effects in K$_3$C$_{60}$ superconductor. The YSR multiplets show identical $d$ orbital-like wave functions that are symmetry-mismatched to the threefold K$_3$C$_{60}$(111) host surface, breaking point-group symmetries of the spatial distribution of YSR bound states in real space. Remarkably, we identify an unprecedented fermion-parity-preserving quantum phase transition between ground states with opposite signs of the uniaxial magnetic anisotropy that can be manipulated by an external magnetic field. These findings can be readily understood in terms of anisotropy splitting of quantum impurity spins, and thus elucidate the intricate interplay between the magnetic anisotropy and YSR multiplets.


title: Learners Teaching Novices: An Uplifting Alternative Assessment

abstract: We propose and carry-out a novel method of formative assessment called Assessment via Teaching (AVT), in which learners demonstrate their understanding of CS1 topics by tutoring more novice students. AVT has powerful benefits over traditional forms of assessment: it is centered around service to others and is highly rewarding for the learners who teach. Moreover, teaching greatly improves the learners' own understanding of the material and has a huge positive impact on novices, who receive free 1:1 tutoring. Lastly, this form of assessment is naturally difficult to cheat -- a critical property for assessments in the era of large-language models. We use AVT in a randomised control trial with learners in a CS1 course at an R1 university. The learners provide tutoring sessions to more novice students taking a lagged online version of the same course. We show that learners who do an AVT session before the course exam performed 20 to 30 percentage points better than the class average on several questions. Moreover, compared to students who did a practice exam, the AVT learners enjoyed their experience more and were twice as likely to study for their teaching session. We believe AVT is a scalable and uplifting method for formative assessment that could one day replace traditional exams.


title: A Picture Is Worth a Graph: Blueprint Debate on Graph for Multimodal Reasoning

abstract: This paper presents a pilot study aimed at introducing multi-agent debate into multimodal reasoning. The study addresses two key challenges: the trivialization of opinions resulting from excessive summarization and the diversion of focus caused by distractor concepts introduced from images. These challenges stem from the inductive (bottom-up) nature of existing debating schemes. To address the issue, we propose a deductive (top-down) debating approach called Blueprint Debate on Graphs (BDoG). In BDoG, debates are confined to a blueprint graph to prevent opinion trivialization through world-level summarization. Moreover, by storing evidence in branches within the graph, BDoG mitigates distractions caused by frequent but irrelevant concepts. Extensive experiments validate BDoG, achieving state-of-the-art results in Science QA and MMBench with significant improvements over previous methods.


title: Trajectory Regularization Enhances Self-Supervised Geometric Representation

abstract: Self-supervised learning (SSL) has proven effective in learning high-quality representations for various downstream tasks, with a primary focus on semantic tasks. However, its application in geometric tasks remains underexplored, partially due to the absence of a standardized evaluation method for geometric representations. To address this gap, we introduce a new pose-estimation benchmark for assessing SSL geometric representations, which demands training without semantic or pose labels and achieving proficiency in both semantic and geometric downstream tasks. On this benchmark, we study enhancing SSL geometric representations without sacrificing semantic classification accuracy. We find that leveraging mid-layer representations improves pose-estimation performance by 10-20%. Further, we introduce an unsupervised trajectory-regularization loss, which improves performance by an additional 4% and improves generalization ability on out-of-distribution data. We hope the proposed benchmark and methods offer new insights and improvements in self-supervised geometric representation learning.


title: AVT2-DWF: Improving Deepfake Detection with Audio-Visual Fusion and Dynamic Weighting Strategies

abstract: With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT2-DWF, the Audio-Visual dual Transformers grounded in Dynamic Weight Fusion, which aims to amplify both intra- and cross-modal forgery cues, thereby enhancing detection capabilities. AVT2-DWF adopts a dual-stage approach to capture both spatial characteristics and temporal dynamics of facial expressions. This is achieved through a face transformer with an n-frame-wise tokenization strategy encoder and an audio transformer encoder. Subsequently, it uses multi-modal conversion with dynamic weight fusion to address the challenge of heterogeneous information fusion between audio and visual modalities. Experiments on DeepfakeTIMIT, FakeAVCeleb, and DFDC datasets indicate that AVT2-DWF achieves state-of-the-art performance intra- and cross-dataset Deepfake detection. Code is available at https://github.com/raining-dev/AVT2-DWF.


title: Classification of right nilpotent $\mathbb{F}_p$-braces of cardinality $p^5$

abstract: In this article the right nilpotent $\mathbb{F}_p$-braces of cardinality $p^5$ has been classified. We use the connection between nilpotent $\mathbb{F}_p$-braces of cardinality $p^5$ and nilpotent pre-Lie algebras of the same order, building on the known relationship between pre-Lie algebras and braces. Leveraging insights from the classification of nilpotent pre-Lie algebras over $\mathbb{F}_p$, we aim to provide a comprehensive classification of right nilpotent $\mathbb{F}_p$-braces of cardinality $p^5$.


title: BCZ map is weakly mixing

abstract: The BCZ map was introduced in 2001 by Boca, Cobeli and Zaharescu as a tool to study the statistical properties of Farey sequences, whose relation to Riemann Hypothesis dates back to Franel and Landau. Later, J. Athreya and the first author observed that the BCZ map arises as a Poincare section of horocycle flow, establishing both ergodicity as well as zero measure-theoretic entropy. In this article, we prove that the BCZ map is weakly mixing, answering the last remaining question about the BCZ map raised in a 2006 survey by Boca and Zaharescu. The proof uses a self-similarity property of the BCZ map that derives from a well-known fact that horocycle flow is renormalized by the geodesic flow, a property already observed in arXiv:1206.6597. We note that the questions of mixing and rigidity remain open.


title: Piecewise-Linear Manifolds for Deep Metric Learning

abstract: Unsupervised deep metric learning (UDML) focuses on learning a semantic representation space using only unlabeled data. This challenging problem requires accurately estimating the similarity between data points, which is used to supervise a deep network. For this purpose, we propose to model the high-dimensional data manifold using a piecewise-linear approximation, with each low-dimensional linear piece approximating the data manifold in a small neighborhood of a point. These neighborhoods are used to estimate similarity between data points. We empirically show that this similarity estimate correlates better with the ground truth than the similarity estimates of current state-of-the-art techniques. We also show that proxies, commonly used in supervised metric learning, can be used to model the piecewise-linear manifold in an unsupervised setting, helping improve performance. Our method outperforms existing unsupervised metric learning approaches on standard zero-shot image retrieval benchmarks.


title: Range-Angle Estimation for FDA-MIMO System With Frequency Offset

abstract: Frequency diverse array multiple-input multiple-output (FDA-MIMO) radar differs from the traditional phased array (PA) radar, and can form range-angle-dependent beampattern and differentiate between closely spaced targets sharing the same angle but occupying distinct range cells. In the FDA-MIMO radar, target range estimation is achieved by employing a subtle frequency variation between adjacent array antennas, so the estimation performance is degraded severely in a practical scenario with frequency offset. In this paper, the range-angle estimation problem for FDA-MIMO radar is considered with frequency offsets in both transmitting and receiving arrays. First, we build a system model for the FDA-MIMO radar with transmitting and receiving frequency offsets. Then, the frequency offset is transferred into an equalized additional noise. The noise characteristics are analyzed in detail theoretically, together with the influence on the range-angle estimation. Moreover, since the effect of the transmitting frequency offset is similar to additional colored noise, denoising algorithms are introduced to mitigate the performance deterioration caused by the frequency offset. Finally, Cram\'{e}r-Rao lower bounds (CRLB) for the range-angle estimation are derived in the scenario with the frequency offsets. Simulation results show the analysis of frequency offset and the corresponding estimation performance using different algorithms.


title: Efficient aerodynamic coefficients prediction with a long sequence neural network

abstract: Traditionally, deriving aerodynamic parameters for an airfoil via Computational Fluid Dynamics requires significant time and effort. However, recent approaches employ neural networks to replace this process, it still grapples with challenges like lack of end-to-end training and interpretability. A novel and more efficient neural network is proposed in this paper, called AirfoilNet. AirfoilNet seamlessly merges mathematical computations with neural networks, thereby augmenting interpretability. It encodes grey-scale airfoil images into a lower-dimensional space for computation with Reynolds number, angle of attack, and geometric coordinates of airfoils. The calculated features are then fed into prediction heads for aerodynamic coefficient predictions, and the entire process is end-to-end. Furthermore, two different prediction heads, Gated Recurrent Unit Net(GRUNet) and Residual Multi-Layer Perceptron(ResMLP), designed to support our iteratively refined prediction scheme. Comprehensive analysis of experimental results underscores AirfoilNet's robust prediction accuracy, generalization capability, and swift inference.


title: Rheo-SINDy: Finding a Constitutive Model from Rheological Data for Complex Fluids Using Sparse Identification for Nonlinear Dynamics

abstract: Rheology plays a pivotal role in understanding the flow behavior of fluids by discovering governing equations that relate deformation and stress, known as constitutive equations. Despite the importance of these equations, current methods for deriving them lack a systematic methodology, often relying on expert knowledge and incurring substantial costs. To overcome this problem, we propose a novel method named {\it Rheo}-SINDy, which employs the sparse identification of nonlinear dynamics (SINDy) algorithm for discovering constitutive models from rheological data. Rheo-SINDy was applied to five distinct scenarios, four with well-established constitutive equations and one without predefined equations. Our results demonstrate that Rheo-SINDy successfully identified accurate models for the known constitutive equations and derived physically plausible approximate models for the scenario without established equations. Notably, the identified approximate models can accurately reproduce nonlinear shear rheological properties, including shear thinning. These findings validate the robustness of Rheo-SINDy in handling real-world data complexities and underscore its efficacy as a tool for advancing the development of data-driven approaches in rheology.


title: Extragradient Sliding for Composite Non-Monotone Variational Inequalities

abstract: Variational inequalities offer a versatile and straightforward approach to analyzing a broad range of equilibrium problems in both theoretical and practical fields. In this paper, we consider a composite generally non-monotone variational inequality represented as a sum of $L_q$-Lipschitz monotone and $L_p$-Lipschitz generally non-monotone operators. We applied a special sliding version of the classical Extragradient method to this problem and obtain better convergence results. In particular, to achieve $\varepsilon$-accuracy of the solution, the oracle complexity of the non-monotone operator $Q$ for our algorithm is $O\left(L_p^2/\varepsilon^2\right)$ in contrast to the basic Extragradient algorithm with $O\left((L_p+L_q)^2/\varepsilon^2\right)$. The results of numerical experiments confirm the theoretical findings and show the superiority of the proposed method.


title: MasonTigers at SemEval-2024 Task 9: Solving Puzzles with an Ensemble of Chain-of-Thoughts

abstract: Our paper presents team MasonTigers submission to the SemEval-2024 Task 9 - which provides a dataset of puzzles for testing natural language understanding. We employ large language models (LLMs) to solve this task through several prompting techniques. Zero-shot and few-shot prompting generate reasonably good results when tested with proprietary LLMs, compared to the open-source models. We obtain further improved results with chain-of-thought prompting, an iterative prompting method that breaks down the reasoning process step-by-step. We obtain our best results by utilizing an ensemble of chain-of-thought prompts, placing 2nd in the word puzzle subtask and 13th in the sentence puzzle subtask. The strong performance of prompted LLMs demonstrates their capability for complex reasoning when provided with a decomposition of the thought process. Our work sheds light on how step-wise explanatory prompts can unlock more of the knowledge encoded in the parameters of large models.


title: Reconstructing the evolution history of networked complex systems

abstract: The evolution processes of complex systems carry key information in the systems' functional properties. Applying machine learning algorithms, we demonstrate that the historical formation process of various networked complex systems can be extracted, including protein-protein interaction, ecology, and social network systems. The recovered evolution process has demonstrations of immense scientific values, such as interpreting the evolution of protein-protein interaction network, facilitating structure prediction, and particularly revealing the key co-evolution features of network structures such as preferential attachment, community structure, local clustering, degree-degree correlation that could not be explained collectively by previous theories. Intriguingly, we discover that for large networks, if the performance of the machine learning model is slightly better than a random guess on the pairwise order of links, reliable restoration of the overall network formation process can be achieved. This suggests that evolution history restoration is generally highly feasible on empirical networks.


title: Validity of annealed approximation in a high-dimensional system

abstract: This study investigates the suitability of the annealed approximation in high-dimensional systems characterized by dense networks with quenched link disorder, employing models of coupled oscillators. We demonstrate that dynamic equations governing dense-network systems converge to those of the complete-graph version in the thermodynamic limit, where link disorder fluctuations vanish entirely. Consequently, the annealed-network systems, where fluctuations are attenuated, also exhibit the same dynamic behavior in the thermodynamic limit. However, a significant discrepancy arises in the incoherent (disordered) phase wherein the finite-size behavior becomes critical in determining the steady-state pattern. To explicitly elucidate this discrepancy, we focus on identical oscillators subject to competitive attractive and repulsive couplings. In the incoherent phase of dense networks, we observe the manifestation of random irregular states. In contrast, the annealed approximation yields a symmetric (regular) incoherent state where two oppositely coherent clusters of oscillators coexist, accompanied by the vanishing order parameter. Our findings imply that the annealed approximation should be employed with caution even in dense-network systems, particularly in the disordered phase.


title: FileDES: A Secure Scalable and Succinct Decentralized Encrypted Storage Network

abstract: Decentralized Storage Network (DSN) is an emerging technology that challenges traditional cloud-based storage systems by consolidating storage capacities from independent providers and coordinating to provide decentralized storage and retrieval services. However, current DSNs face several challenges associated with data privacy and efficiency of the proof systems. To address these issues, we propose FileDES (\uline{D}ecentralized \uline{E}ncrypted \uline{S}torage), which incorporates three essential elements: privacy preservation, scalable storage proof, and batch verification. FileDES provides encrypted data storage while maintaining data availability, with a scalable Proof of Encrypted Storage (PoES) algorithm that is resilient to Sybil and Generation attacks. Additionally, we introduce a rollup-based batch verification approach to simultaneously verify multiple files using publicly verifiable succinct proofs. We conducted a comparative evaluation on FileDES, Filecoin, Storj and Sia under various conditions, including a WAN composed of up to 120 geographically dispersed nodes. Our protocol outperforms the others in terms of proof generation/verification efficiency, storage costs, and scalability.


title: AI Teaches the Art of Elegant Coding: Timely, Fair, and Helpful Style Feedback in a Global Course

abstract: Teaching students how to write code that is elegant, reusable, and comprehensible is a fundamental part of CS1 education. However, providing this "style feedback" in a timely manner has proven difficult to scale. In this paper, we present our experience deploying a novel, real-time style feedback tool in Code in Place, a large-scale online CS1 course. Our tool is based on the latest breakthroughs in large-language models (LLMs) and was carefully designed to be safe and helpful for students. We used our Real-Time Style Feedback tool (RTSF) in a class with over 8,000 diverse students from across the globe and ran a randomized control trial to understand its benefits. We show that students who received style feedback in real-time were five times more likely to view and engage with their feedback compared to students who received delayed feedback. Moreover, those who viewed feedback were more likely to make significant style-related edits to their code, with over 79% of these edits directly incorporating their feedback. We also discuss the practicality and dangers of LLM-based tools for feedback, investigating the quality of the feedback generated, LLM limitations, and techniques for consistency, standardization, and safeguarding against demographic bias, all of which are crucial for a tool utilized by students.


title: Generative Active Learning for Image Synthesis Personalization

abstract: This paper presents a pilot study that explores the application of active learning, traditionally studied in the context of discriminative models, to generative models. We specifically focus on image synthesis personalization tasks. The primary challenge in conducting active learning on generative models lies in the open-ended nature of querying, which differs from the closed form of querying in discriminative models that typically target a single concept. We introduce the concept of anchor directions to transform the querying process into a semi-open problem. We propose a direction-based uncertainty sampling strategy to enable generative active learning and tackle the exploitation-exploration dilemma. Extensive experiments are conducted to validate the effectiveness of our approach, demonstrating that an open-source model can achieve superior performance compared to closed-source models developed by large companies, such as Google's StyleDrop. The source code is available at https://github.com/zhangxulu1996/GAL4Personalization.


title: Risk and Response in Large Language Models: Evaluating Key Threat Categories

abstract: This paper explores the pressing issue of risk assessment in Large Language Models (LLMs) as they become increasingly prevalent in various applications. Focusing on how reward models, which are designed to fine-tune pretrained LLMs to align with human values, perceive and categorize different types of risks, we delve into the challenges posed by the subjective nature of preference-based training data. By utilizing the Anthropic Red-team dataset, we analyze major risk categories, including Information Hazards, Malicious Uses, and Discrimination/Hateful content. Our findings indicate that LLMs tend to consider Information Hazards less harmful, a finding confirmed by a specially developed regression model. Additionally, our analysis shows that LLMs respond less stringently to Information Hazards compared to other risks. The study further reveals a significant vulnerability of LLMs to jailbreaking attacks in Information Hazard scenarios, highlighting a critical security concern in LLM risk assessment and emphasizing the need for improved AI safety measures.


title: MasonTigers at SemEval-2024 Task 8: Performance Analysis of Transformer-based Models on Machine-Generated Text Detection

abstract: This paper presents the MasonTigers entry to the SemEval-2024 Task 8 - Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection. The task encompasses Binary Human-Written vs. Machine-Generated Text Classification (Track A), Multi-Way Machine-Generated Text Classification (Track B), and Human-Machine Mixed Text Detection (Track C). Our best performing approaches utilize mainly the ensemble of discriminator transformer models along with sentence transformer and statistical machine learning approaches in specific cases. Moreover, zero-shot prompting and fine-tuning of FLAN-T5 are used for Track A and B.


title: MasonTigers at SemEval-2024 Task 1: An Ensemble Approach for Semantic Textual Relatedness

abstract: This paper presents the MasonTigers entry to the SemEval-2024 Task 1 - Semantic Textual Relatedness. The task encompasses supervised (Track A), unsupervised (Track B), and cross-lingual (Track C) approaches across 14 different languages. MasonTigers stands out as one of the two teams who participated in all languages across the three tracks. Our approaches achieved rankings ranging from 11th to 21st in Track A, from 1st to 8th in Track B, and from 5th to 12th in Track C. Adhering to the task-specific constraints, our best performing approaches utilize ensemble of statistical machine learning approaches combined with language-specific BERT based models and sentence transformers.


title: Key varieties for prime $\mathbb{Q}$-Fano threefolds defined by Jordan algebras of cubic forms. Part I

abstract: The first aim of this paper is to construct a $13$-dimensional affine variety $\mathscr{H}_{\mathbb{A}}^{13}$ related with $\mathbb{P}^{2}\times\mathbb{P}^{2}$-fibration. It is well-known that the affine cone of the Segre embedded $\mathbb{P}^{2}\times\mathbb{P}^{2}$ is defined as the null loci of the so called $\sharp$-mapping of a 9-dimensional nondegenerate quadratic Jordan algebra $J$ of a cubic form. Inspired with this fact, we construct $\mathscr{H}_{\mathbb{A}}^{13}$ in the same way coordinatizing $J$ with 8 parameters. We derive such a coordinatization of $J$ using fixed three complementary primitive idempotents and the associated Peirce decomposition of $J$. The second aim of this paper is to construct complex prime $\mathbb{Q}$-Fano $3$-folds of anti-canonical codimension 4 as weighted complete intersections of appropriate weighted projectivizations of $\mathscr{H}_{\mathbb{A}}^{13}$ or its subvarieties (possibly allowing some coordinates with weight $0$). The affine variety $\mathscr{H}_{\mathbb{A}}^{13}$ and such weighted projectivizations of $\mathscr{H}_{\mathbb{A}}^{13}$ are called key varieties for prime $\mathbb{Q}$-Fano 3-folds. We show that a prime $\mathbb{Q}$-Fano 3-fold of genus $3$ with three $\frac{1}{2}(1,1,1)$-singularities belonging to the class of No.5.4 as in [Tak1] is constructed from one weighted projectivization of $\mathscr{H}_{\mathbb{A}}^{13}$ such that all the coordinates have positive weights. Conversely, we also show that any such a prime $\mathbb{Q}$-Fano 3-fold is obtained in this way. Moreover, relating $\mathscr{H}_{\mathbb{A}}^{13}$ with the $C_{2}$-cluster variety constructed by Coughlan and Ducat [CD1], we show that weighted projectivizations of $\mathscr{H}_{\mathbb{A}}^{13}$ or its subvarieties are key varieties for prime $\mathbb{Q}$-Fano 3-folds belonging to 108 classes in the online database [GRDB].


title: Vanishing of Resistivity upon Freezing of Vortex Liquid in Clean Superconductors

abstract: Superconducting transition, defined as vanishing of the resistivity, under a magnetic field in a clean bulk type II superconductor with weak sample disorder is believed to be a reflection of freezing of the vortex liquid to a kind of vortex solids. This fundamental issue on superconductivity is examined in detail. Based on the Ginzburg-Landau fluctuation theory for a three-dimensional (3D) system and through a supplementary study in 2D case, we find that the resistivity in the weakly disordered 3D case vanishes in a nearly discontinuous way, reflecting growth of the Bragg peaks on approaching the vortex lattice melting transition. In contrast, such a sharp decrease of the resistivity does not clearly appear in the corresponding 2D case. The consequences of this difference in the vanishing behavior of the resistivity between the 2D and 3D systems are discussed in relation to available experimental facts.


title: Search for R-Parity-Violation-Induced Charged Lepton Flavor Violation at Future Lepton Colliders

abstract: Interest in searches for Charged Lepton Flavor Violation (CLFV) has continued in the past few decades since the observation of CLFV will indicate new physics beyond the Standard Model (BSM). As several future lepton colliders with high luminosity have been proposed, the search for CLFV will reach an unprecedented level of precision. Many BSM models allow CLFV processes at the tree level, such as the R-parity-violating (RPV) Minimal Supersymmetric Standard Model (MSSM), which is a good choice for benchmark. In this paper, we perform a detailed fast Monte Carlo simulation study on RPV-induced CLFV processes at future lepton colliders, including a 240 GeV circular electron positron collider (CEPC) and a 6 or 14 TeV muon collider. As a result, we found that the upper limits on the $\tau$ related RPV couplings will be significantly improved, while several new limits on RPV couplings can be set, which are inaccessible by low-energy experiments.


title: Enhancing Positronium Lifetime Imaging through Two-Component Reconstruction in Time-of-Flight Positron Emission Tomography

abstract: Positron Emission Tomography (PET) is a crucial tool in medical imaging, particularly for diagnosing diseases like cancer and Alzheimer's. The advent of Positronium Lifetime Imaging (PLI) has opened new avenues for assessing the tissue micro-environment, which is vital for early-stage disease detection. In this study, we introduce a two-component reconstruction model for PLI in Time-of-Flight (TOF) PET, incorporating both ortho-positronium and para-positronium decays. Our model enhances the accuracy of positronium imaging by providing a more detailed representation of the tissue environment. We conducted simulation studies to evaluate the performance of our model and compared it with existing single-component models. The results demonstrate the superiority of the two-component model in capturing the intricacies of the tissue micro-environment, thus paving the way for more precise and informative PET diagnostics.


title: Improve Cross-domain Mixed Sampling with Guidance Training for Adaptive Segmentation

abstract: Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles UDA for dense prediction, the goal is to circumvent the need for costly pixel-level annotations. Typically, various prevailing methods baseline rely on constructing intermediate domains via cross-domain mixed sampling techniques to mitigate the performance decline caused by domain gaps. However, such approaches generate synthetic data that diverge from real-world distributions, potentially leading the model astray from the true target distribution. To address this challenge, we propose a novel auxiliary task called Guidance Training. This task facilitates the effective utilization of cross-domain mixed sampling techniques while mitigating distribution shifts from the real world. Specifically, Guidance Training guides the model to extract and reconstruct the target-domain feature distribution from mixed data, followed by decoding the reconstructed target-domain features to make pseudo-label predictions. Importantly, integrating Guidance Training incurs minimal training overhead and imposes no additional inference burden. We demonstrate the efficacy of our approach by integrating it with existing methods, consistently improving performance. The implementation will be available at https://github.com/Wenlve-Zhou/Guidance-Training.


title: What we can learn about compact binary mergers from their kilonova signals?

abstract: Compact binary mergers are sources of gravitational waves, and can be accompanied by electromagnetic signals. We discuss the possible features in the kilonova emissions which may help distinguish the black hole - neutron star mergers from the binary neutron stars. In addition, the amount of ejected material may depend on whether the system undergoes the creation of a transient hyper-massive, differentially rotating neutron star. In this context, the numerical simulations of post-merger systems and their outflows are important for our understanding of the nature of short GRB progenitor systems. In this article, we present a suite of GR MHD simulations performed by the CTP PAS astrophysics group, to model the neutrino driven disk winds and their contribution to the kilonova emissions. The contribution of the disk wind to the jet collimation and variability is also briefly discussed.


title: Linear Quadratic Guidance Law for Joint Motion Planning of a Pursuer-Turret Assembly

abstract: This paper presents joint motion planning of a vehicle with an attached rotating turret. The turret has a limited range as well as the field of view. The objective is capture a maneuvering target such that at the terminal time it is withing the field-of-view and range limits. Catering to it, we present a minimum effort guidance law that commensurate for the turn rate abilities of the vehicle and the turret. The guidance law is obtained using linearization about the collision triangle and admits an analytical solution. Simulation results are presented to exemplify the cooperation between the turret and the vehicle.


title: Precise measurement of the $e^+e^-\to D_s^+D_s^-$ cross sections at center-of-mass energies from threshold to 4.95 GeV

abstract: Using the $e^+e^-$ collision data collected with the BESIII detector operating at the BEPCII collider, at center-of-mass energies from the threshold to $4.95$~GeV, we present precise measurements of the cross sections for the process $e^+e^-\to D_s^+D_s^-$ using a single tag method. The resulting cross section lineshape exhibits several new structures, thereby offering an input for coupled channel analysis and model tests, which are critical to understand vector charmonium-like states with masses between 4 and 5~GeV.


title: Magic for the Age of Quantized DNNs

abstract: Recently, the number of parameters in DNNs has explosively increased, as exemplified by LLMs (Large Language Models), making inference on small-scale computers more difficult. Model compression technology is, therefore, essential for integration into products. In this paper, we propose a method of quantization-aware training. We introduce a novel normalization (Layer-Batch Normalization) that is independent of the mini-batch size and does not require any additional computation cost during inference. Then, we quantize the weights by the scaled round-clip function with the weight standardization. We also quantize activation functions using the same function and apply surrogate gradients to train the model with both quantized weights and the quantized activation functions. We call this method Magic for the age of Quantised DNNs (MaQD). Experimental results show that our quantization method can be achieved with minimal accuracy degradation.


title: Heavy multiquark systems as clusters of smaller units -- a diffusion Monte Carlo calculation --

abstract: Multiquark systems appear less frequently than mesons and baryons despite the enormous world-wide experimental effort that has been made during the last two decades. In this work, we will propose a possible explanation for that fact, restricting ourselves to the case of sets including only $c$ and $\bar{c}$ quarks. We will show that those multiquarks can be thought as different combinations of smaller units that associate together to produce colorless assemblies with a definite value of the total spin. For instance, for the $cccccc$ hexaquark with $S=0$, we have three possibilities: a set of six undistinguishable $c$ quarks, an association of two $ccc$ baryons, or a set of three $cc$ diquarks close together. This means we can have three different values for the mass of an open-charm hexaquark with $S=0$. Using the diffusion Monte Carlo method, we calculate all possible combinations compatible with tetraquark $cc \bar{c} \bar{c}$, pentaquark $cccc \bar{c}$, open-charm $cccccc$ and hidden-charm $ccc \bar{c} \bar{c} \bar{c}$ hexaquark structures with the minimum value of total spin ($S=0$ or $S=1/2$). We consider compact structures with radial wave functions including interactions between all the quarks in the cluster. We find that, in all cases, the mass of the multiquark decreases with the number of small units that conform the set of quarks. For instance, an open charm hexaquark made up of three diquarks has a smaller mass than a set of six of $c$ undistinguishable units. When the pieces that conform the multiquark are themselves colorless with a definite value of the total spin, the cluster splits into those smaller units that separate infinitely from each other.


title: Torsion Pairs in Categories of Modules on Ringed Finite Sites

abstract: Let $\mathcal{C}$ be a small category. In this paper, we mainly study the category of modules $\mathfrak{M}\mbox{od-}\mathfrak{R}$ on ringed sites $(\mathbf{C},\mathfrak{R})$. We firstly reprove the Theorem A of the paper (M. Wu and F. Xu. Skew category algebras and modules on ringed finite sites. J. A. 631, 2023), then we characterize $\mathfrak{M}\mbox{od-}\mathfrak{R}$ in terms of the torsion presheaves on $Gr(\mathfrak{R})$, where $Gr(\mathfrak{R})$ is the linear Grothendieck construction of $\mathfrak{R}$. Finally, we investigate the hereditary torsion pairs, TTF triples and Abelian recollements of $\mathfrak{M}\mbox{od-}\mathfrak{R}$. When $\mathcal{C}$ is finite, the complete classifications of all these are given respectively.


title: A generalised sigmoid population growth model with energy dependence: application to quantify the tipping point for Antarctic shallow seabed algae

abstract: Sigmoid growth models are often used to study population dynamics. The size of a population at equilibrium commonly depends explicitly on the availability of resources, such as an energy or nutrient source, which is not explicit in standard sigmoid growth models. A simple generalised extension of sigmoid growth models is introduced that can explicitly account for this resource-dependence, demonstrated by three examples of this family of models of increasing mathematical complexity. Each model is calibrated and compared to observed data for algae under sea-ice in Antarctic coastal waters. It was found that through careful construction, models satisfying the proposed framework can estimate key properties of a sea-ice break-out controlled tipping point for the algae, which cannot be estimated using standard sigmoid growth models. The proposed broader family of energy-dependent sigmoid growth models likely has usage in many population growth contexts where resources limit population size.


title: Can MAG be an EFT? Radiative Stability and Ghost Resurgence in Massive Vector Models

abstract: We explore the one-loop structure of some ghost and tachyon-free vector theories to illustrate the role of structural constraints in their interactions, even in the absence of gauge symmetries. While the presence of explicit soft-breaking terms might suggest otherwise, we illustrate how the hopes of casting a model within the predictive frame of effective field methods require a gauge-like treatment of their interactions.


title: ParFormer: Vision Transformer Baseline with Parallel Local Global Token Mixer and Convolution Attention Patch Embedding

abstract: This work presents ParFormer as an enhanced transformer architecture that allows the incorporation of different token mixers into a single stage, hence improving feature extraction capabilities. Integrating both local and global data allows for precise representation of short- and long-range spatial relationships without the need for computationally intensive methods such as shifting windows. Along with the parallel token mixer encoder, We offer the Convolutional Attention Patch Embedding (CAPE) as an enhancement of standard patch embedding to improve token mixer extraction with a convolutional attention module. Our comprehensive evaluation demonstrates that our ParFormer outperforms CNN-based and state-of-the-art transformer-based architectures in image classification and several complex tasks such as object recognition. The proposed CAPE has been demonstrated to benefit the overall MetaFormer architecture, even while utilizing the Identity Mapping Token Mixer, resulting in a 0.5\% increase in accuracy. The ParFormer models outperformed ConvNeXt and Swin Transformer for the pure convolution and transformer model in accuracy. Furthermore, our model surpasses the current leading hybrid transformer by reaching competitive Top-1 scores in the ImageNet-1K classification test. Specifically, our model variants with 11M, 23M, and 34M parameters achieve scores of 80.4\%, 82.1\%, and 83.1\%, respectively. Code: https://github.com/novendrastywn/ParFormer-CAPE-2024


title: Coupled circularly polarized electromagnetic soliton states in magnetized plasmas

abstract: The interaction between two co-propagating electromagnetic pulses in a magnetized plasma is considered, from first principles, relying on a fluid-Maxwell model. Two circularly polarized wavepackets by same group velocities are considered, characterized by opposite circular polarization, to be identified as left-hand- or right hand circularly polarized (i.e. LCP or RCP, respectively). A multiscale perturbative technique is adopted, leading to a pair of coupled nonlinear Schrodinger-type (NLS) equations for the modulated amplitudes of the respective vector potentials associated with the two pulses. Systematic analysis reveals the existence, in certain frequency bands, of three different types of vector soliton modes: an LCP-bright/RCP-bright coupled soliton pair state, an LCP bright/RCP-dark soliton pair, and an LCP-dark/RCP-bright soliton pair. The value of the magnetic field plays a critical role since it determines the type of vector solitons that may occur in certain frequency bands and, on the other hand, it affects the width of those frequency bands that are characterized by a specific type of vector soliton (type). The magnetic field (strength) thus arises as an order parameter, affecting the existence conditions of each type of solution (in the form of an envelope soliton pair). An exhaustive parametric investigation is presented in terms of frequency bands and in a wide range of magnetic field (strength) values, leading to results that may be applicable in beam-plasma interaction scenarios as well as in space plasmas and in the ionosphere.


title: Lecture notes on stationary critical and super-critical SPDEs

abstract: The goal of these lecture notes is to present recent results regarding the large-scale behaviour of critical and super-critical non-linear stochastic PDEs, that fall outside the realm of the theory of Regularity Structures. These include the two-dimensional Anisotropic KPZ equation, the stochastic Burgers equation in dimension $d\ge 2$ and the stochastic Navier-Stokes equation with divergence-free noise in dimension $d=2$. Rather than providing complete proofs, we try to emphasise the main ideas, and some crucial aspects of our approach: the role of the generator equation and of the Fluctuation-Dissipation Theorem to identify the limit process; Wiener chaos decomposition with respect to the stationary measure and its truncation; and the so-called Replacement Lemma, which controls the weak coupling limit of the equations in the critical dimension and identifies the limiting diffusivity. For pedagogical reasons, we will focus exclusively on the stochastic Burgers equation. The notes are based on works in collaboration with Dirk Erhard and Massimiliano Gubinelli.


title: Learning Neural Free-Energy Functionals with Pair-Correlation Matching

abstract: The intrinsic Helmholtz free-energy functional, the centerpiece of classical density functional theory (cDFT), is at best only known approximately for 3D systems. Here we introduce a method for learning a quasi-exact neural-network approximation of this functional by exclusively training on a dataset of radial distribution functions, circumventing the need to sample costly heterogeneous density profiles in a wide variety of external potentials. For a supercritical 3D Lennard-Jones system, we demonstrate that the learned neural free-energy functional accurately predicts planar inhomogeneous density profiles under various complex external potentials obtained from simulations.


title: Tri-Perspective View Decomposition for Geometry-Aware Depth Completion

abstract: Depth completion is a vital task for autonomous driving, as it involves reconstructing the precise 3D geometry of a scene from sparse and noisy depth measurements. However, most existing methods either rely only on 2D depth representations or directly incorporate raw 3D point clouds for compensation, which are still insufficient to capture the fine-grained 3D geometry of the scene. To address this challenge, we introduce Tri-Perspective view Decomposition (TPVD), a novel framework that can explicitly model 3D geometry. In particular, (1) TPVD ingeniously decomposes the original point cloud into three 2D views, one of which corresponds to the sparse depth input. (2) We design TPV Fusion to update the 2D TPV features through recurrent 2D-3D-2D aggregation, where a Distance-Aware Spherical Convolution (DASC) is applied. (3) By adaptively choosing TPV affinitive neighbors, the newly proposed Geometric Spatial Propagation Network (GSPN) further improves the geometric consistency. As a result, our TPVD outperforms existing methods on KITTI, NYUv2, and SUN RGBD. Furthermore, we build a novel depth completion dataset named TOFDC, which is acquired by the time-of-flight (TOF) sensor and the color camera on smartphones. Project page: https://yanzq95.github.io/projectpage/TOFDC/index.html


title: TexRO: Generating Delicate Textures of 3D Models by Recursive Optimization

abstract: This paper presents TexRO, a novel method for generating delicate textures of a known 3D mesh by optimizing its UV texture. The key contributions are two-fold. We propose an optimal viewpoint selection strategy, that finds the most miniature set of viewpoints covering all the faces of a mesh. Our viewpoint selection strategy guarantees the completeness of a generated result. We propose a recursive optimization pipeline that optimizes a UV texture at increasing resolutions, with an adaptive denoising method that re-uses existing textures for new texture generation. Through extensive experimentation, we demonstrate the superior performance of TexRO in terms of texture quality, detail preservation, visual consistency, and, notably runtime speed, outperforming other current methods. The broad applicability of TexRO is further confirmed through its successful use on diverse 3D models.


title: Clean-image Backdoor Attacks

abstract: To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure, even in cases where some annotated errors occur, as the impact of these minor inaccuracies on the final performance of the models is negligible and existing backdoor attacks require attacker's ability to poison the training images. Nevertheless, in this paper, we propose clean-image backdoor attacks which uncover that backdoors can still be injected via a fraction of incorrect labels without modifying the training images. Specifically, in our attacks, the attacker first seeks a trigger feature to divide the training images into two parts: those with the feature and those without it. Subsequently, the attacker falsifies the labels of the former part to a backdoor class. The backdoor will be finally implanted into the target model after it is trained on the poisoned data. During the inference phase, the attacker can activate the backdoor in two ways: slightly modifying the input image to obtain the trigger feature, or taking an image that naturally has the trigger feature as input. We conduct extensive experiments to demonstrate the effectiveness and practicality of our attacks. According to the experimental results, we conclude that our attacks seriously jeopardize the fairness and robustness of image classification models, and it is necessary to be vigilant about the incorrect labels in outsourced labeling.


title: Cell Tracking according to Biological Needs -- Strong Mitosis-aware Random-finite Sets Tracker with Aleatoric Uncertainty

abstract: Cell tracking and segmentation assist biologists in extracting insights from large-scale microscopy time-lapse data. Driven by local accuracy metrics, current tracking approaches often suffer from a lack of long-term consistency. To address this issue, we introduce an uncertainty estimation technique for neural tracking-by-regression frameworks and incorporate it into our novel extended Poisson multi-Bernoulli mixture tracker. Our uncertainty estimation identifies uncertain associations within high-performing tracking-by-regression methods using problem-specific test-time augmentations. Leveraging this uncertainty, along with a novel mitosis-aware assignment problem formulation, our tracker resolves false associations and mitosis detections stemming from long-term conflicts. We evaluate our approach on nine competitive datasets and demonstrate that it outperforms the current state-of-the-art on biologically relevant metrics substantially, achieving improvements by a factor of approximately $5.75$. Furthermore, we uncover new insights into the behavior of tracking-by-regression uncertainty.


title: Empirical investigation of multi-source cross-validation in clinical machine learning

abstract: Traditionally, machine learning-based clinical prediction models have been trained and evaluated on patient data from a single source, such as a hospital. Cross-validation methods can be used to estimate the accuracy of such models on new patients originating from the same source, by repeated random splitting of the data. However, such estimates tend to be highly overoptimistic when compared to accuracy obtained from deploying models to sources not represented in the dataset, such as a new hospital. The increasing availability of multi-source medical datasets provides new opportunities for obtaining more comprehensive and realistic evaluations of expected accuracy through source-level cross-validation designs. In this study, we present a systematic empirical evaluation of standard K-fold cross-validation and leave-source-out cross-validation methods in a multi-source setting. We consider the task of electrocardiogram based cardiovascular disease classification, combining and harmonizing the openly available PhysioNet CinC Challenge 2021 and the Shandong Provincial Hospital datasets for our study. Our results show that K-fold cross-validation, both on single-source and multi-source data, systemically overestimates prediction performance when the end goal is to generalize to new sources. Leave-source-out cross-validation provides more reliable performance estimates, having close to zero bias though larger variability. The evaluation highlights the dangers of obtaining misleading cross-validation results on medical data and demonstrates how these issues can be mitigated when having access to multi-source data.


title: Extracting Human Attention through Crowdsourced Patch Labeling

abstract: In image classification, a significant problem arises from bias in the datasets. When it contains only specific types of images, the classifier begins to rely on shortcuts - simplistic and erroneous rules for decision-making. This leads to high performance on the training dataset but inferior results on new, varied images, as the classifier's generalization capability is reduced. For example, if the images labeled as mustache consist solely of male figures, the model may inadvertently learn to classify images by gender rather than the presence of a mustache. One approach to mitigate such biases is to direct the model's attention toward the target object's location, usually marked using bounding boxes or polygons for annotation. However, collecting such annotations requires substantial time and human effort. Therefore, we propose a novel patch-labeling method that integrates AI assistance with crowdsourcing to capture human attention from images, which can be a viable solution for mitigating bias. Our method consists of two steps. First, we extract the approximate location of a target using a pre-trained saliency detection model supplemented by human verification for accuracy. Then, we determine the human-attentive area in the image by iteratively dividing the image into smaller patches and employing crowdsourcing to ascertain whether each patch can be classified as the target object. We demonstrated the effectiveness of our method in mitigating bias through improved classification accuracy and the refined focus of the model. Also, crowdsourced experiments validate that our method collects human annotation up to 3.4 times faster than annotating object locations with polygons, significantly reducing the need for human resources. We conclude the paper by discussing the advantages of our method in a crowdsourcing context, mainly focusing on aspects of human errors and accessibility.


title: Single-pixel edge enhancement of object via convolutional filtering with localized vortex phase

abstract: Microscopy is an essential tool in imaging research, and the edge-enhanced microscope by using the vortex filter is of particular interest as an optical information processing that highlights amplitude and phase edges of object in all directions. The application of this technique is not limited to the visible range, but edge enhancement of object in invisible wavelength is also crucial for near-infrared fluorescence and electronic circuit inspection through silicon semiconductors. One disadvantage of near-infrared imaging is that digital cameras such as CCD and CMOS become much more expensive than cameras for the visible spectrum. As an cost-effective method to implement invisible edge enhancement, the Fourier single-pixel imaging has already been proposed without using a camera, but using a single-pixel detector. However, this method requires 3 or 4 times more single-pixel measurements due to the three-phase or four-phase shift to detect optical complex amplitude in Fourier domain. In response, we propose a method for single-pixel edge enhancement of object via convolutional filtering with a localized vortex phase, eliminating the extra single-pixel measurements required by the phase-shifting method. Our simulation results show that the correlation coefficient between the ideal edges of an object and the edge enhanced by our proposed method is 0.95, indicating that our method is effective way to detect the edges. This novel and effective approach for enhancing and detecting the edges of object can be valuable in various invisible imaging applications.


title: Generalized gyrovector spaces revisited

abstract: We revise a proof of a Mazur-Ulam theorem for generalized gyrovector spaces.


title: Search for heavy Majorana neutrinos in $e^{\pm} e^{\pm}$ and $e^{\pm} \mu^{\pm}$ final states via WW scattering in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A search for heavy Majorana neutrinos in scattering of same-sign $W$ boson pairs in proton-proton collisions at $\sqrt{s}= 13$ TeV at the LHC is reported. The dataset used corresponds to an integrated luminosity of 140 fb$^{-1}$, collected with the ATLAS detector during 2015-2018. The search is performed in final states including a same-sign $ee$ or $e\mu$ pair and at least two jets with large invariant mass and a large rapidity difference. No significant excess of events with respect to the Standard Model background predictions is observed. The results are interpreted in a benchmark scenario of the Phenomenological Type-I Seesaw model. New constraints are set on the values of the $\vert V_{e N} \vert^{2}$ and $\vert V_{e N} V^{*}_{\mu N} \vert$ parameters for heavy Majorana neutrino masses between 50 GeV and 20 TeV, where $V_{\ell N}$ is the matrix element describing the mixing of the heavy Majorana neutrino mass eigenstate with the Standard Model neutrino of flavour $\ell = e, \mu$. The sensitivity to the Weinberg operator is investigated and constraints on the effective $ee$ and $e\mu$ Majorana neutrino masses are reported. The statistical combination of the $ee$ and $e\mu$ channels with the previously published $\mu\mu$ channel is performed.


title: Vehicle Detection Performance in Nordic Region

abstract: This paper addresses the critical challenge of vehicle detection in the harsh winter conditions in the Nordic regions, characterized by heavy snowfall, reduced visibility, and low lighting. Due to their susceptibility to environmental distortions and occlusions, traditional vehicle detection methods have struggled in these adverse conditions. The advanced proposed deep learning architectures brought promise, yet the unique difficulties of detecting vehicles in Nordic winters remain inadequately addressed. This study uses the Nordic Vehicle Dataset (NVD), which has UAV images from northern Sweden, to evaluate the performance of state-of-the-art vehicle detection algorithms under challenging weather conditions. Our methodology includes a comprehensive evaluation of single-stage, two-stage, and transformer-based detectors against the NVD. We propose a series of enhancements tailored to each detection framework, including data augmentation, hyperparameter tuning, transfer learning, and novel strategies designed explicitly for the DETR model. Our findings not only highlight the limitations of current detection systems in the Nordic environment but also offer promising directions for enhancing these algorithms for improved robustness and accuracy in vehicle detection amidst the complexities of winter landscapes. The code and the dataset are available at https://nvd.ltu-ai.dev


title: Computing monomial bases in Lie theory using OSCAR

abstract: In this survey, we present a detailed guide on using the computer algebra system OSCAR to compute monomial bases for simple, finite-dimensional modules of simple, complex Lie algebras. We will also demonstrate how to determine monomial bases for the homogeneous coordinate ring of a (partial) flag variety, depending on a chosen birational sequence and a monomial order. This survey will be updated to reflect any advancements in OSCAR's capabilities in these areas.


title: BSNet: Box-Supervised Simulation-assisted Mean Teacher for 3D Instance Segmentation

abstract: 3D instance segmentation (3DIS) is a crucial task, but point-level annotations are tedious in fully supervised settings. Thus, using bounding boxes (bboxes) as annotations has shown great potential. The current mainstream approach is a two-step process, involving the generation of pseudo-labels from box annotations and the training of a 3DIS network with the pseudo-labels. However, due to the presence of intersections among bboxes, not every point has a determined instance label, especially in overlapping areas. To generate higher quality pseudo-labels and achieve more precise weakly supervised 3DIS results, we propose the Box-Supervised Simulation-assisted Mean Teacher for 3D Instance Segmentation (BSNet), which devises a novel pseudo-labeler called Simulation-assisted Transformer. The labeler consists of two main components. The first is Simulation-assisted Mean Teacher, which introduces Mean Teacher for the first time in this task and constructs simulated samples to assist the labeler in acquiring prior knowledge about overlapping areas. To better model local-global structure, we also propose Local-Global Aware Attention as the decoder for teacher and student labelers. Extensive experiments conducted on the ScanNetV2 and S3DIS datasets verify the superiority of our designs. Code is available at \href{https://github.com/peoplelu/BSNet}{https://github.com/peoplelu/BSNet}.


title: All van der Waals three-terminal SOT-MRAM realized by topological ferromagnet Fe3GeTe2

abstract: Magnetic van der Waals (vdW) materials have attracted massive attention because of their academic interest and application potential for the past few years. Its main advantage is the intrinsic two-dimensionality, enabling much smaller devices of novel concepts. One particular exciting direction lies in the current-driven spin-orbit torque (SOT). Here, we, for the first time, realize an all vdW three-terminal SOT memory, employing the unique physics principle of gigantic intrinsic SOT of Fe3GeTe2 (FGT) and the well-known industry-adopted tunnelling magnetoresistance (TMR) effect. We designed the device operation procedure and fabricated the FGT/h-BN/FGT vdW heterostructure as a proof of concept. This device exhibits a classical TMR effect and unambiguously demonstrates the conception by precise performance as expected: the magnetic information of the top-FGT is written by current-driven SOT and read out by TMR separately. The writing and reading current paths are physically decoupled, enhancing the design and optimization flexibility substantially and further strengthening the device's endurance naturally. Our work would prompt more expansive use of vdW magnets for spintronic applications.


title: Programmers Prefer Individually Assigned Tasks vs. Shared Responsibility

abstract: In traditional management, tasks are typically assigned to individuals, with each worker taking full responsibility for the success or failure of a task. In contrast, modern Agile, Lean, and eXtreme Programming practices advocate for shared responsibility, where an entire group is accountable for the outcome of a project or task. Despite numerous studies in other domains, the preferences of programmers have not been thoroughly analyzed. To address this gap, we conducted a survey featuring seven situational questions and collected the opinions of 120 software development practitioners. Our findings reveal that programmers prefer tasks to be assigned to them on an individual basis and appreciate taking personal responsibility for failures, as well as receiving individual rewards for successes. Understanding these preferences is crucial for project managers aiming to optimize team dynamics and ensure the successful completion of software projects.


title: Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning

abstract: Lottery ticket hypothesis for deep neural networks emphasizes the importance of initialization used to re-train the sparser networks obtained using the iterative magnitude pruning process. An explanation for why the specific initialization proposed by the lottery ticket hypothesis tends to work better in terms of generalization (and training) performance has been lacking. Moreover, the underlying principles in iterative magnitude pruning, like the pruning of smaller magnitude weights and the role of the iterative process, lack full understanding and explanation. In this work, we attempt to provide insights into these phenomena by empirically studying the volume/geometry and loss landscape characteristics of the solutions obtained at various stages of the iterative magnitude pruning process.


title: Ellipsoidal embeddings of graphs

abstract: Due to their flexibility to represent almost any kind of relational data, graph-based models have enjoyed a tremendous success over the past decades. While graphs are inherently only combinatorial objects, however, many prominent analysis tools are based on the algebraic representation of graphs via matrices such as the graph Laplacian, or on associated graph embeddings. Such embeddings associate to each node a set of coordinates in a vector space, a representation which can then be employed for learning tasks such as the classification or alignment of the nodes of the graph. As the geometric picture provided by embedding methods enables the use of a multitude of methods developed for vector space data, embeddings have thus gained interest both from a theoretical as well as a practical perspective. Inspired by trace-optimization problems, often encountered in the analysis of graph-based data, here we present a method to derive ellipsoidal embeddings of the nodes of a graph, in which each node is assigned a set of coordinates on the surface of a hyperellipsoid. Our method may be seen as an alternative to popular spectral embedding techniques, to which it shares certain similarities we discuss. To illustrate the utility of the embedding we conduct a case study in which we analyse synthetic and real world networks with modular structure, and compare the results obtained with known methods in the literature.


title: Riemannian Optimization and the Hartree-Fock Method

abstract: In the present work we studied a subfield of Applied Mathematics called Riemannian Optimization. The main goal of this subfield is to generalize algorithms, theorems and tools from Mathematical Optimization to the case in which the optimization problem is defined on a Riemannian manifold. As a case study, we implemented some of the main algorithms described in the literature (Gradient Descent, Newton-Raphson and Conjugate Gradient) to solve an optimization problem known as Hartree-Fock. This method is extremely important in the field of Computational Quantum Chemistry and it is a good case study because it is a problem somewhat hard to solve and, as a consequence of this, it requires many tools from Riemannian Optimization. Besides, it is also a good example to see how these algorithms perform in practice.


title: Robust Conformal Prediction under Distribution Shift via Physics-Informed Structural Causal Model

abstract: Uncertainty is critical to reliable decision-making with machine learning. Conformal prediction (CP) handles uncertainty by predicting a set on a test input, hoping the set to cover the true label with at least $(1-\alpha)$ confidence. This coverage can be guaranteed on test data even if the marginal distributions $P_X$ differ between calibration and test datasets. However, as it is common in practice, when the conditional distribution $P_{Y|X}$ is different on calibration and test data, the coverage is not guaranteed and it is essential to measure and minimize the coverage loss under distributional shift at \textit{all} possible confidence levels. To address these issues, we upper bound the coverage difference at all levels using the cumulative density functions of calibration and test conformal scores and Wasserstein distance. Inspired by the invariance of physics across data distributions, we propose a physics-informed structural causal model (PI-SCM) to reduce the upper bound. We validated that PI-SCM can improve coverage robustness along confidence level and test domain on a traffic speed prediction task and an epidemic spread task with multiple real-world datasets.


title: VRSO: Visual-Centric Reconstruction for Static Object Annotation

abstract: As a part of the perception results of intelligent driving systems, static object detection (SOD) in 3D space provides crucial cues for driving environment understanding. With the rapid deployment of deep neural networks for SOD tasks, the demand for high-quality training samples soars. The traditional, also reliable, way is manual labeling over the dense LiDAR point clouds and reference images. Though most public driving datasets adopt this strategy to provide SOD ground truth (GT), it is still expensive (requires LiDAR scanners) and low-efficient (time-consuming and unscalable) in practice. This paper introduces VRSO, a visual-centric approach for static object annotation. VRSO is distinguished in low cost, high efficiency, and high quality: (1) It recovers static objects in 3D space with only camera images as input, and (2) manual labeling is barely involved since GT for SOD tasks is generated based on an automatic reconstruction and annotation pipeline. (3) Experiments on the Waymo Open Dataset show that the mean reprojection error from VRSO annotation is only 2.6 pixels, around four times lower than the Waymo labeling (10.6 pixels). Source code is available at: https://github.com/CaiYingFeng/VRSO.


title: Grey-informed neural network for time-series forecasting

abstract: Neural network models have shown outstanding performance and successful resolutions to complex problems in various fields. However, the majority of these models are viewed as black-box, requiring a significant amount of data for development. Consequently, in situations with limited data, constructing appropriate models becomes challenging due to the lack of transparency and scarcity of data. To tackle these challenges, this study suggests the implementation of a grey-informed neural network (GINN). The GINN ensures that the output of the neural network follows the differential equation model of the grey system, improving interpretability. Moreover, incorporating prior knowledge from grey system theory enables traditional neural networks to effectively handle small data samples. Our proposed model has been observed to uncover underlying patterns in the real world and produce reliable forecasts based on empirical data.


title: How Physics Students Develop Disciplinary Computational Literacy

abstract: Computation has revolutionized science and is gradually making its way into science teaching and learning. However, we currently lack theoretical frameworks to make sense of how students learn to use computation as a disciplinary tool. In this study, we propose disciplinary computational literacy as a productive theoretical lens on this subject. This theoretical perspective views computation as a new type of literacy consisting of material, cognitive, and social elements. We argue that these elements will necessarily vary by discipline and use case studies of two pairs of students writing computational essays in an intermediate physics course to examine how disciplinary computational literacy looks and is built at an undergraduate level. Through these case studies we see the pairs leveraging the different elements of their computational literacy to both engage with and produce computational literature in their discipline, while also engaging in a process of epistemic negotiation between their interests, the course goals, available tools, and their basis of computational literacy. These cases show how computational literacy can highlight the ways in which scientific computing helps students build disciplinary understanding and also shows that computational essays, as a genre of computational literature, are a useful epistemic form for developing computational literacy.


title: On the Solution Uniqueness of Data-Driven Modeling of Flexible Loads

abstract: This letter first explores the solution uniqueness of the data-driven modeling of price-responsive flexible loads (PFL). The PFL on the demand side is critical in modern power systems. An accurate PFL model is fundamental for system operations. Yet, whether the PFL model can be uniquely and correctly identified from operational data remains unclear. To address this, we analyze the structural and practical identifiability of the PFL model, deriving the condition for the solution uniqueness. Based on this, we point out the implications for selecting physical models of PFL to enhance the identification results. Numerical results validate this work.