title: Model predictive control strategy in waked wind farms for optimal fatigue loads

abstract: With the rapid growth of wind power penetration, wind farms (WFs) are required to implement frequency regulation that active power control to track a given power reference. Due to the wake interaction of the wind turbines (WTs), there is more than one solution to distributing power reference among the operating WTs, which can be exploited as an optimization problem for the second goal, such as fatigue load alleviation. In this paper, a closed-loop model predictive controller is developed that minimizes the wind farm tracking errors, the dynamical fatigue load, and and the load equalization. The controller is evaluated in a mediumfidelity model. A 64 WTs simulation case study is used to demonstrate the control performance for different penalty factor settings. The results indicated the WF can alleviate dynamical fatigue load and have no significant impact on power tracking. However, the uneven load distribution in the wind turbine system poses challenges for maintenance. By adding a trade-off between the load equalization and dynamical fatigue load, the load differences between WTs are significantly reduced, while the dynamical fatigue load slightly increases when selecting a proper penalty factor.


title: SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases

abstract: Graph Neural Networks (GNNs) with equivariant properties have emerged as powerful tools for modeling complex dynamics of multi-object physical systems. However, their generalization ability is limited by the inadequate consideration of physical inductive biases: (1) Existing studies overlook the continuity of transitions among system states, opting to employ several discrete transformation layers to learn the direct mapping between two adjacent states; (2) Most models only account for first-order velocity information, despite the fact that many physical systems are governed by second-order motion laws. To incorporate these inductive biases, we propose the Second-order Equivariant Graph Neural Ordinary Differential Equation (SEGNO). Specifically, we show how the second-order continuity can be incorporated into GNNs while maintaining the equivariant property. Furthermore, we offer theoretical insights into SEGNO, highlighting that it can learn a unique trajectory between adjacent states, which is crucial for model generalization. Additionally, we prove that the discrepancy between this learned trajectory of SEGNO and the true trajectory is bounded. Extensive experiments on complex dynamical systems including molecular dynamics and motion capture demonstrate that our model yields a significant improvement over the state-of-the-art baselines.


title: Transversal family of non-autonomous conformal iterated function systems

abstract: We study Non-autonomous Iterated Function Systems (NIFSs) with overlaps. A NIFS on a compact subset $X\subset\mathbb{R}^m$ is a sequence $\Phi=(\{\phi^{(j)}_{i}\}_{i\in I^{(j)}})_{j=1}^{\infty}$ of collections of uniformly contracting maps $\phi^{(j)}_{i}: X\rightarrow X$, where $I^{(j)}$ is a finite set. In comparison to usual iterated function systems, we allow the contractions $\phi^{(j)}_{i}$ applied at each step $j$ to depend on $j$. In this paper, we focus on a family of parameterized NIFSs on $\mathbb{R}^m$. Here, we do not assume the open set condition. We show that if a $d-$parameter family of such systems satisfies the transversality condition, then for almost every parameter value the Hausdorff dimension of the limit set is the minimum of $m$ and the Bowen dimension. Moreover, we give an example of a family $\{\Phi_t\}_{t\in U}$ of parameterized NIFSs such that $\{\Phi_t\}_{t\in U}$ satisfies the transversality condition but $\Phi_t$ does not satisfy the open set condition for any $t\in U$.


title: Gl-QFOM and Gl-QGMRES: two efficient algorithms for quaternion linear systems with multiple right-hand sides

abstract: In this paper, we propose the global quaternion full orthogonalization (Gl-QFOM) and global quaternion generalized minimum residual (Gl-QGMRES) methods, which are built upon global orthogonal and oblique projections onto a quaternion matrix Krylov subspace, for solving quaternion linear systems with multiple right-hand sides. We first develop the global quaternion Arnoldi procedure to preserve the quaternion Hessenberg form during the iterations. We then establish the convergence analysis of the proposed methods, and show how to apply them to solve the Sylvester quaternion matrix equation. Numerical examples are provided to illustrate the effectiveness of our methods compared with the traditional Gl-FOM and Gl-GMRES iterations for the real representations of the original linear systems.


title: Predictive Network Configuration with Hierarchical Spectral Clustering for Software Defined Vehicles

abstract: The increasing connectivity and autonomy of vehicles has led to a growing need for dynamic and real-time adjustments to software and network configurations. Software Defined Vehicles (SDV) have emerged as a potential solution to adapt to changing user needs with continuous updates and onboard reconfigurations to offer infotainment, connected, and background services such as cooperative driving. However, network configuration management in SDVs remains a significant challenge, particularly in the context of shared Ethernet-based in-vehicle networks. Traditional worst-case static configuration methods cannot efficiently allocate network resources while ensuring Quality of Service (QoS) guarantees for each network flow within the physical topology capabilities. In this work, we propose a configuration generation methodology that addresses these limitations by dynamically switching between pre-computed offboard configurations downloaded to the vehicle. Simulation results are presented and future work is discussed.


title: A generalization of a theorem of Brass and Schmeisser

abstract: Let $n$ be an odd positive integer. It was proved by Brass and Schmeisser that for every quadrature $$\mathcal{Q}=\alpha_1f(x_1)+\dots+\alpha_mf(x_m),$$ (with positive weights) of order at least $n+1$ and for every $n-$convex function $f,$ the value of $Q$ on $f$ lies between the values of Gauss and Lobatto quadratures of order $n+1$ calculated for the same function $f$. We generalize this result in two directions, replacing $Q$ by an integral with respect to a given measure and allowing the number $n$ to any positive integer (for even $n$ Radau quadratures replace Gauss and Lobatto ones


title: GEMTrans: A General, Echocardiography-based, Multi-Level Transformer Framework for Cardiovascular Diagnosis

abstract: Echocardiography (echo) is an ultrasound imaging modality that is widely used for various cardiovascular diagnosis tasks. Due to inter-observer variability in echo-based diagnosis, which arises from the variability in echo image acquisition and the interpretation of echo images based on clinical experience, vision-based machine learning (ML) methods have gained popularity to act as secondary layers of verification. For such safety-critical applications, it is essential for any proposed ML method to present a level of explainability along with good accuracy. In addition, such methods must be able to process several echo videos obtained from various heart views and the interactions among them to properly produce predictions for a variety of cardiovascular measurements or interpretation tasks. Prior work lacks explainability or is limited in scope by focusing on a single cardiovascular task. To remedy this, we propose a General, Echo-based, Multi-Level Transformer (GEMTrans) framework that provides explainability, while simultaneously enabling multi-video training where the inter-play among echo image patches in the same frame, all frames in the same video, and inter-video relationships are captured based on a downstream task. We show the flexibility of our framework by considering two critical tasks including ejection fraction (EF) and aortic stenosis (AS) severity detection. Our model achieves mean absolute errors of 4.15 and 4.84 for single and dual-video EF estimation and an accuracy of 96.5 % for AS detection, while providing informative task-specific attention maps and prototypical explainability.


title: MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning

abstract: Supervised visual captioning models typically require a large scale of images or videos paired with descriptions in a specific language (i.e., the vision-caption pairs) for training. However, collecting and labeling large-scale datasets is time-consuming and expensive for many scenarios and languages. Therefore, sufficient labeled pairs are usually not available. To deal with the label shortage problem, we present a simple yet effective zero-shot approach MultiCapCLIP that can generate visual captions for different scenarios and languages without any labeled vision-caption pairs of downstream datasets. In the training stage, MultiCapCLIP only requires text data for input. Then it conducts two main steps: 1) retrieving concept prompts that preserve the corresponding domain knowledge of new scenarios; 2) auto-encoding the prompts to learn writing styles to output captions in a desired language. In the testing stage, MultiCapCLIP instead takes visual data as input directly to retrieve the concept prompts to generate the final visual descriptions. The extensive experiments on image and video captioning across four benchmarks and four languages (i.e., English, Chinese, German, and French) confirm the effectiveness of our approach. Compared with state-of-the-art zero-shot and weakly-supervised methods, our method achieves 4.8% and 21.5% absolute improvements in terms of BLEU@4 and CIDEr metrics. Our code is available at https://github.com/yangbang18/MultiCapCLIP.


title: Physics-informed neural networks for unsteady incompressible flows with time-dependent moving boundaries

abstract: Physics-informed neural networks (PINNs) employed in fluid mechanics deal primarily with stationary boundaries. This hinders the capability to address a wide range of flow problems involving moving bodies. To this end, we propose a novel extension, which enables PINNs to solve incompressible flows with time-dependent moving boundaries. More specifically, we impose Dirichlet constraints of velocity at the moving interfaces and define new loss functions for the corresponding training points. Moreover, we refine training points for flows around the moving boundaries for accuracy. This effectively enforces the no-slip condition of the moving boundaries. With an initial condition, the extended PINNs solve unsteady flow problems with time-dependent moving boundaries and still have the flexibility to leverage partial data to reconstruct the entire flow field. Therefore, the extended version inherits the amalgamation of both physics and data from the original PINNs. With a series of typical flow problems, we demonstrate the effectiveness and accuracy of the extended PINNs. The proposed concept allows for solving inverse problems as well, which calls for further investigations.


title: Improved Lerey inequality and Trudinger-Moser type inequality involving the Leray potential

abstract: We obtain three types of results in this paper. Firstly we improve Leray's inequality by providing several types of reminder terms, secondly we introduce several Hilbert spaces based on these improved Leray inequalities and discuss their embedding properties, thirdly we obtain some Trudinger-Moser type inequalities in the unit ball of R2 associated with the norms of these Hilbert spaces where the Leray potential is used. Our approach is based on analysis of radially symmetric functions.


title: A Steady Loop Current Does Not Radiate

abstract: According to mainstream electrodynamics, a steady loop current does not radiate. Edward, Kenyon, and Lemon took the approximated electric field formula (the magnetic one is trivial) for a moving point charge and showed that the electric field of a steady loop current could be partitioned into a static field falling with the square of distance and an integral of an exact differential (also called total differential, full differential, or perfect differential), thus no radiation was omitted. Inspired by their work, we do the same to the electric and magnetic fields without approximation.


title: Bayesian Reasoning for Physics Informed Neural Networks

abstract: We present the application of the physics-informed neural network (PINN) approach in Bayesian formulation. We have adopted the Bayesian neural network framework to obtain posterior densities from Laplace approximation. For each model or fit, the evidence is computed, which is a measure that classifies the hypothesis. The optimal solution is the one with the highest value of evidence. We have proposed a modification of the Bayesian algorithm to obtain hyperparameters of the model. We have shown that within the Bayesian framework, one can obtain the relative weights between the boundary and equation contributions to the total loss. Presented method leads to predictions comparable to those obtained by sampling from the posterior distribution within the Hybrid Monte Carlo algorithm (HMC). We have solved heat, wave, and Burger's equations, and the results obtained are in agreement with the exact solutions, demonstrating the effectiveness of our approach. In Burger's equation problem, we have demonstrated that the framework can combine information from differential equations and potential measurements. All solutions are provided with uncertainties (induced by the model's parameter dependence) computed within the Bayesian framework.

categories: physics.comp-ph cs.LG physics.flu-dyn stat.ML


title: EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior

abstract: While image diffusion models have made significant progress in text-driven 3D content creation, they often fail to accurately capture the intended meaning of text prompts, especially for view information. This limitation leads to the Janus problem, where multi-faced 3D models are generated under the guidance of such diffusion models. In this paper, we propose a robust high-quality 3D content generation pipeline by exploiting orthogonal-view image guidance. First, we introduce a novel 2D diffusion model that generates an image consisting of four orthogonal-view sub-images based on the given text prompt. Then, the 3D content is created using this diffusion model. Notably, the generated orthogonal-view image provides strong geometric structure priors and thus improves 3D consistency. As a result, it effectively resolves the Janus problem and significantly enhances the quality of 3D content creation. Additionally, we present a 3D synthesis fusion network that can further improve the details of the generated 3D contents. Both quantitative and qualitative evaluations demonstrate that our method surpasses previous text-to-3D techniques. Project page: https://efficientdreamer.github.io.


title: Exponential Euler method for stiff stochastic differential equations with additive fractional Brownian noise

abstract: We discuss a system of stochastic differential equations with a stiff linear term and additive noise driven by fractional Brownian motions (fBms) with Hurst parameter H>1/2, which arise e. g., from spatial approximations of stochastic partial differential equations. For their numerical approximation, we present an exponential Euler scheme and show that it converges in the strong sense with an exact rate close to the Hurst parameter H. Further, based on (E. Buckwar, M.G. Riedler, and P.E. Kloeden 2011), we conclude the existence of a unique stationary solution of the exponential Euler scheme that is pathwise asymptotically stable.


title: DPF-Net: Combining Explicit Shape Priors in Deformable Primitive Field for Unsupervised Structural Reconstruction of 3D Objects

abstract: Unsupervised methods for reconstructing structures face significant challenges in capturing the geometric details with consistent structures among diverse shapes of the same category. To address this issue, we present a novel unsupervised structural reconstruction method, named DPF-Net, based on a new Deformable Primitive Field (DPF) representation, which allows for high-quality shape reconstruction using parameterized geometric primitives. We design a two-stage shape reconstruction pipeline which consists of a primitive generation module and a primitive deformation module to approximate the target shape of each part progressively. The primitive generation module estimates the explicit orientation, position, and size parameters of parameterized geometric primitives, while the primitive deformation module predicts a dense deformation field based on a parameterized primitive field to recover shape details. The strong shape prior encoded in parameterized geometric primitives enables our DPF-Net to extract high-level structures and recover fine-grained shape details consistently. The experimental results on three categories of objects in diverse shapes demonstrate the effectiveness and generalization ability of our DPF-Net on structural reconstruction and shape segmentation.


title: Flexo-electricity of the dowser texture

abstract: The persistent quasi-planar nematic texture known also as the dowser texture is characterized by a 2D unitary vector field d. We show here that the dowser texture is sensitive, in first order, to electric fields. This property is due to the flexo-electric polarisation P collinear with d expected from R.B. Meyer's considerations on flexo-electricity in nematics. It is pointed out that due to the flexo-electric polarisation nematic monopoles can be manipulated by electric fields of appropriated geometry.


title: Deviations from $\mu$-$\tau$ symmetry using $\Delta$(27) group on neutrino masses and mixings

abstract: Implication of neutrino mass model based on $\Delta$(27) discrete flavor symmetry, on parameters of neutrino oscillations, CP violation and effective neutrino masses is studied using type-I seesaw mechanism. The Standard Model particle content is extended by adding two additional Higgs doublets, three right-handed neutrinos and two scalar triplets under $\Delta$(27) symmetry predicting diagonal charged lepton mass matrix. This can generate the desired deviation from $\mu - \tau$ symmetry. The resulting neutrino oscillation parameters are well agreed with the latest global fit oscillation data. The sum of the three absolute neutrino mass eigenvalues, $\sum\limits_{i}|m_{i}|$ (i=1,2,3) is found to be consistent with that of the value given by latest Planck cosmological data, $\sum\limits_{i}|m_{i}|<$0.12 eV. The model further predicts effective neutrino masses for neutrinoless double beta decay, 4.15 meV $\leq m_{ee}\leq$ 30.6 meV, tritium beta decay, 8.4 meV $\leq m_{\beta}\leq$ 30.5 meV, Jarlskog invariant, $J_{CP}=\pm 0.022$ for CP violation, baryon asymmetry $Y_{B}=1.15 \times 10^{-10}$ for normal hierarchical case; and also 49.5 meV $\leq m_{ee}\leq$ 51.7 meV, 49.5 meV $\leq m_{\beta}\leq$ 51.4 meV, $J_{CP}=\pm 0.022$, $Y_{B}=1.12\times 10^{-10}$ for inverted hierarchical case respectively.


title: Meaningful XAI Based on User-Centric Design Methodology

abstract: This report first takes stock of XAI-related requirements appearing in various EU directives, regulations, guidelines, and CJEU case law. This analysis of existing requirements will permit us to have a clearer vision of the purposes, the ``why'', of XAI, which we separate into five categories: contestability, empowerment/redressing information asymmetries, control over system performance, evaluation of algorithmic decisions, and public administration transparency. The analysis of legal requirements also permits us to create four categories of recipients for explainability: data science teams; human operators of the system; persons affected by algorithmic decisions, and regulators/judges/auditors. Lastly, we identify four main operational contexts for explainability: XAI for the upstream design and testing phase; XAI for human-on-the-loop control; XAI for human-in-the-loop control; and XAI for ex-post challenges and investigations.Second, we will present user-centered design methodology, which takes the purposes, the recipients and the operational context into account in order to develop optimal XAI solutions.Third, we will suggest a methodology to permit suppliers and users of high-risk AI applications to propose local XAI solutions that are effective in the sense of being ``meaningful'', for example, useful in light of the operational, safety and fundamental rights contexts. The process used to develop these ``meaningful'' XAI solutions will be based on user-centric design principles examined in the second part.Fourth, we will suggest that the European Commission issue guidelines to provide a harmonised approach to defining ``meaningful'' explanations based on the purposes, audiences and operational contexts of AI systems. These guidelines would apply to the AI Act, but also to the other EU texts requiring explanations for algorithmic systems and results.


title: ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Tracking

abstract: Multi-Camera Multi-Object Tracking (MC-MOT) utilizes information from multiple views to better handle problems with occlusion and crowded scenes. Recently, the use of graph-based approaches to solve tracking problems has become very popular. However, many current graph-based methods do not effectively utilize information regarding spatial and temporal consistency. Instead, they rely on single-camera trackers as input, which are prone to fragmentation and ID switch errors. In this paper, we propose a novel reconfigurable graph model that first associates all detected objects across cameras spatially before reconfiguring it into a temporal graph for Temporal Association. This two-stage association approach enables us to extract robust spatial and temporal-aware features and address the problem with fragmented tracklets. Furthermore, our model is designed for online tracking, making it suitable for real-world applications. Experimental results show that the proposed graph model is able to extract more discriminating features for object tracking, and our model achieves state-of-the-art performance on several public datasets.


title: Giant atomic swirl in graphene bilayers with biaxial heterostrain

abstract: The study of moir\'e engineering started with the advent of van der Waals heterostructures in which stacking two-dimensional layers with different lattice constants leads to a moir\'e pattern controlling their electronic properties. The field entered a new era when it was found that adjusting the twist between two graphene layers led to strongly-correlated-electron physics and topological effects associated with atomic relaxation. Twist is now used routinely to adjust the properties of two-dimensional materials. Here, we investigate a new type of moir\'e superlattice in bilayer graphene when one layer is biaxially strained with respect to the other - so-called biaxial heterostrain. Scanning tunneling microscopy measurements uncover spiraling electronic states associated with a novel symmetry-breaking atomic reconstruction at small biaxial heterostrain. Atomistic calculations using experimental parameters as inputs reveal that a giant atomic swirl forms around regions of aligned stacking to reduce the mechanical energy of the bilayer. Tight-binding calculations performed on the relaxed structure show that the observed electronic states decorate spiraling domain wall solitons as required by topology. This study establishes biaxial heterostrain as an important parameter to be harnessed for the next step of moir\'e engineering in van der Waals multilayers.


title: Radiation Hardness of MALTA2 Monolithic CMOS Sensors on Czochralski Substrates

abstract: MALTA2 is the latest full-scale prototype of the MALTA family of Depleted Monolithic Active Pixel Sensors (DMAPS) produced in Tower Semiconductor 180 nm CMOS technology. In order to comply with the requirements of High Energy Physics (HEP) experiments, various process modifications and front-end changes have been implemented to achieve low power consumption, reduce Random Telegraph Signal (RTS) noise, and optimise the charge collection geometry. Compared to its predecessors, MALTA2 targets the use of a high-resistivity, thick Czochralski (Cz) substrates in order to demonstrate radiation hardness in terms of detection efficiency and timing resolution up to 3E15 1 MeV neq/cm2 with backside metallisation to achieve good propagation of the bias voltage. This manuscript shows the results that were obtained with non-irradiated and irradiated MALTA2 samples on Cz substrates from the CERN SPS test beam campaign from 2021-2023 using the MALTA telescope.


title: Estimating and approaching maximum information rate of noninvasive visual brain-computer interface

abstract: The mission of visual brain-computer interfaces (BCIs) is to enhance information transfer rate (ITR) to reach high speed towards real-life communication. Despite notable progress, noninvasive visual BCIs have encountered a plateau in ITRs, leaving it uncertain whether higher ITRs are achievable. In this study, we investigate the information rate limits of the primary visual channel to explore whether we can and how we should build visual BCI with higher information rate. Using information theory, we estimate a maximum achievable ITR of approximately 63 bits per second (bps) with a uniformly-distributed White Noise (WN) stimulus. Based on this discovery, we propose a broadband WN BCI approach that expands the utilization of stimulus bandwidth, in contrast to the current state-of-the-art visual BCI methods based on steady-state visual evoked potentials (SSVEPs). Through experimental validation, our broadband BCI outperforms the SSVEP BCI by an impressive margin of 7 bps, setting a new record of 50 bps. This achievement demonstrates the possibility of decoding 40 classes of noninvasive neural responses within a short duration of only 0.1 seconds. The information-theoretical framework introduced in this study provides valuable insights applicable to all sensory-evoked BCIs, making a significant step towards the development of next-generation human-machine interaction systems.


title: An extension of the generator coordinate method with basis optimization

abstract: The generator coordinate method (GCM) has been a well-known method to describe nuclear collective motions. In this method, one specifies {\it a priori} the relevant collective degrees of freedom as input of the method, based on empirical and/or phenomenological assumptions. We here propose a new extension of the GCM, in which both the basis Slater determinants and weight factors are optimized according to the variational principle. Applying this method to $^{16}$O and $^{28}$Si nuclei with the Skyrme functional, we demonstrate that the optimized bases correspond to excited states along a collective path, unlike the conventional GCM which superposes only the local ground states. This implies that a collective coordinate for large amplitude collective motions is determined in a much more complex way than what has been assumed so far.


title: Decoding Natural Images from EEG for Object Recognition

abstract: Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a self-supervised framework to demonstrate the feasibility of learning image representations from EEG signals, particularly for object recognition. The framework utilizes image and EEG encoders to extract features from paired image stimuli and EEG responses. Contrastive learning aligns these two modalities by constraining their similarity. With the framework, we attain significantly above-chance results on a comprehensive EEG-image dataset, achieving a top-1 accuracy of 15.6% and a top-5 accuracy of 42.8% in challenging 200-way zero-shot tasks. Moreover, we perform extensive experiments to explore the biological plausibility by resolving the temporal, spatial, spectral, and semantic aspects of EEG signals. Besides, we introduce attention modules to capture spatial correlations, providing implicit evidence of the brain activity perceived from EEG data. These findings yield valuable insights for neural decoding and brain-computer interfaces in real-world scenarios. The code will be released on https://github.com/eeyhsong/NICE-EEG.


title: Observation of multiple steady states with engineered dissipation

abstract: Simulating the dynamics of open quantum systems is essential in achieving practical quantum computation and understanding novel nonequilibrium behaviors. However, quantum simulation of a many-body system coupled to an engineered reservoir has yet to be fully explored in present-day experiment platforms. In this work, we introduce engineered noise into a one-dimensional ten-qubit superconducting quantum processor to emulate a generic many-body open quantum system. Our approach originates from the stochastic unravellings of the master equation. By measuring the end-to-end correlation, we identify multiple steady states stemmed from a strong symmetry, which is established on the modified Hamiltonian via Floquet engineering. Furthermore, we find that the information saved in the initial state maintains in the steady state driven by the continuous dissipation on a five-qubit chain. Our work provides a manageable and hardware-efficient strategy for the open-system quantum simulation.


title: Black-box Unsupervised Domain Adaptation with Bi-directional Atkinson-Shiffrin Memory

abstract: Black-box unsupervised domain adaptation (UDA) learns with source predictions of target data without accessing either source data or source models during training, and it has clear superiority in data privacy and flexibility in target network selection. However, the source predictions of target data are often noisy and training with them is prone to learning collapses. We propose BiMem, a bi-directional memorization mechanism that learns to remember useful and representative information to correct noisy pseudo labels on the fly, leading to robust black-box UDA that can generalize across different visual recognition tasks. BiMem constructs three types of memory, including sensory memory, short-term memory, and long-term memory, which interact in a bi-directional manner for comprehensive and robust memorization of learnt features. It includes a forward memorization flow that identifies and stores useful features and a backward calibration flow that rectifies features' pseudo labels progressively. Extensive experiments show that BiMem achieves superior domain adaptation performance consistently across various visual recognition tasks such as image classification, semantic segmentation and object detection.


title: On the Teichm{\"u}ller space of acute triangles

abstract: We continue the study of the analogue of Thurston's metric on the Teichm{\"u}ller space of Euclidean triangle which was started by Saglam and Papadopoulos in [1].By direct calculation, we give explicit expressions of the distance function and the Finsler structure of the metric restricted to the subspace of acute triangles.We deduce from the form of the Finsler unit sphere a result on the infinitesimal rigidity of the metric.We give a description of the maximal stretching loci for a family of extreme Lipschitz maps.


title: Twisted shift preserving operators on $L^{2}(\mathbb{R}^{2n})$

abstract: We introduce the J map using the Zak transform associated with the Weyl transform on $L^{2}(\mathbb{R}^{2n})$. We obtain a decomposition for a twisted shift-invariant subspace of $L^{2}(\mathbb{R}^{2n})$ as a direct sum of mutually orthogonal principal twisted shift-invariant spaces such that the respective system of twisted translates forms a Parseval frame sequence. We establish that the twisted shift preserving operators and the corresponding range operators simultaneously share some properties in common, namely, self-adjoint, unitary, range of the spectrum and bounded below properties. We prove that the frame operator and its inverse associated with a system of twisted translates of {\varphi_s}_{s\in Z} are shift preserving. We also show that the corresponding range operators turn out to be the dual Gramian and its inverse associated with the collection {J\varphi_s(. , .)}_{s\in Z}.


title: The Newlander-Nirenberg Theorem for principal bundles

abstract: Let $G$ be an arbitrary (not necessarily isomorphic to a closed subgroup of $\mathrm{GL}(r,\mathbb{C})$) complex Lie group, $U$ a complex manifold and $p:P\to U$ a $\mathcal{C}^\infty$ principal $G$-bundle on $U$. We introduce and study the space $\mathcal{J}^\kappa_P$ of bundle almost complex structures of H{\"o}lder class $\mathcal{C}^\kappa$ on $P$. To any $J\in \mathcal{J}^\kappa_P$ we associate an $\mathrm{Ad}(P)$-valued form $\mathfrak{f}_J$ of type (0,2) on $U$ which should be interpreted as the obstruction to the integrability of $J$. For $\kappa\geq 1$ we have $\mathfrak{f}_J\in\mathcal{C}^{\kappa-1}(U,\bigwedge\hspace{-3.5pt}^{0,2}_{\,\,U}\otimes\mathrm{Ad}(P))$ whereas, for $\kappa\in[0,1)$, $\mathfrak{f}_J$ is a form with distribution coefficients. Let $J\in \mathcal{J}^\kappa_P$ with $\kappa\in (0,+\infty]\setminus\mathbb{N}$. We prove that $J$ admits locally $J$-pseudo-holomorphic sections of class $\mathcal{C}^{\kappa+1}$ if and only if $\mathfrak{f}_J=0$. If this is the case, $J$ defines a holomorphic reduction of the underlying $\mathcal{C}^{\kappa+1}$-bundle of $P$ in the sense of the theory of principal bundles on complex manifolds. The proof is based on classical regularity results for the $\bar\partial$-Neumann operator on compact, strictly pseudo-convex complex manifolds with boundary.The result will be used in forthcoming articles dedicated to moduli spaces of holomorphic bundles (on a compact complex manifold $X$) framed along a real hypersurface $S\subset X$.


title: Simply connectedness and hyperbolicity

abstract: We generalize to arbitrary dimension our previous construction of simply connected weakly-special but not special varieties. We show that they satisfy the function field and complex analytic part of Campana's conjecture. Moreover, we give the first examples, in any dimension, of smooth simply connected nonisotrivial projective varieties of general type that satisfy the function field Lang's conjecture.


title: WSTac: Interactive Surface Perception based on Whisker-Inspired and Self-Illuminated Vision-Based Tactile Sensor

abstract: Modern Visual-Based Tactile Sensors (VBTSs) use cost-effective cameras to track elastomer deformation, but struggle with ambient light interference. Solutions typically involve using internal LEDs and blocking external light, thus adding complexity. Creating a VBTS resistant to ambient light with just a camera and an elastomer remains a challenge. In this work, we introduce WStac, a self-illuminating VBTS comprising a mechanoluminescence (ML) whisker elastomer, camera, and 3D printed parts. The ML whisker elastomer, inspired by the touch sensitivity of vibrissae, offers both light isolation and high ML intensity under stress, thereby removing the necessity for additional LED modules. With the incorporation of machine learning, the sensor effectively utilizes the dynamic contact variations of 25 whiskers to successfully perform tasks like speed regression, directional identification, and texture classification. Videos are available at: https://sites.google.com/view/wstac/.


title: Optimizing Group-Fair Plackett-Luce Ranking Models for Relevance and Ex-Post Fairness

abstract: In learning-to-rank (LTR), optimizing only the relevance (or the expected ranking utility) can cause representational harm to certain categories of items. Moreover, if there is implicit bias in the relevance scores, LTR models may fail to optimize for true relevance. Previous works have proposed efficient algorithms to train stochastic ranking models that achieve fairness of exposure to the groups ex-ante (or, in expectation), which may not guarantee representation fairness to the groups ex-post, that is, after realizing a ranking from the stochastic ranking model. Typically, ex-post fairness is achieved by post-processing, but previous work does not train stochastic ranking models that are aware of this post-processing. In this paper, we propose a novel objective that maximizes expected relevance only over those rankings that satisfy given representation constraints to ensure ex-post fairness. Building upon recent work on an efficient sampler for ex-post group-fair rankings, we propose a group-fair Plackett-Luce model and show that it can be efficiently optimized for our objective in the LTR framework. Experiments on three real-world datasets show that our group-fair algorithm guarantees fairness alongside usually having better relevance compared to the LTR baselines. In addition, our algorithm also achieves better relevance than post-processing baselines, which also ensures ex-post fairness. Further, when implicit bias is injected into the training data, our algorithm typically outperforms existing LTR baselines in relevance.


title: Compact binary systems in Einstein-Aether gravity: Direct integration of the relaxed field equations to 2.5 post-Newtonian order

abstract: The Einstein-Aether theory is an alternative theory of gravity in which the spacetime metric is supplemented by a long-range timelike vector field (the "aether" field). Here, for the first time, we apply the full formalism of post-Minkowskian theory and of the Direct Integration of the Relaxed Einstein Equations (DIRE), to this theory of gravity, with the goal of deriving equations of motion and gravitational waveforms for orbiting compact bodies to high orders in a post-Newtonian expansion. Because the aether field is constrained to have unit norm, a naive application of post-Minkowskian theory leads to contributions to the effective energy momentum tensor that are {\em linear} in the perturbative fields. We show that a suitable redefinition of fields using an array of "superpotentials" can eliminate such linear terms to any desired post-Newtonian order, resulting in flat spacetime wave equations for all fields, with sources consisting of matter terms and terms quadratic and higher in the fields. As an initial application of this new method, and as a foundation for obtaining the equations of motion for compact binaries, we obtain explicit solutions of the relaxed equations sufficient to obtain the metric in the near zone through 2.5 post-Newtonian order, or $O[(v/c)^5]$ beyond the Newtonian approximation.


title: Significant-attributed Community Search in Heterogeneous Information Networks

abstract: Community search is a personalized community discovery problem aimed at finding densely-connected subgraphs containing the query vertex. In particular, the search for communities with high-importance vertices has recently received a great deal of attention. However, existing works mainly focus on conventional homogeneous networks where vertices are of the same type, but are not applicable to heterogeneous information networks (HINs) composed of multi-typed vertices and different semantic relations, such as bibliographic networks. In this paper, we study the problem of high-importance community search in HINs. A novel community model is introduced, named heterogeneous significant community (HSC), to unravel the closely connected vertices of the same type with high attribute values through multiple semantic relationships. An HSC not only maximizes the exploration of indirect relationships across entities of the anchor-type but incorporates their significance. To search the HSCs, we first develop online algorithms by exploiting both segmented-based meta-path expansion and significance increment. Specially, a solution space reuse strategy based on structural nesting is designed to boost the efficiency. In addition, we further devise a two-level index to support searching HSCs in optimal time, based on which a space-efficient compact index is proposed. Extensive experiments on real-world large-scale HINs demonstrate that our solutions are effective and efficient for searching HSCs, and the index-based algorithms are 2-4 orders of magnitude faster than online algorithms.


title: Unpaired Multi-domain Attribute Translation of 3D Facial Shapes with a Square and Symmetric Geometric Map

abstract: While impressive progress has recently been made in image-oriented facial attribute translation, shape-oriented 3D facial attribute translation remains an unsolved issue. This is primarily limited by the lack of 3D generative models and ineffective usage of 3D facial data. We propose a learning framework for 3D facial attribute translation to relieve these limitations. Firstly, we customize a novel geometric map for 3D shape representation and embed it in an end-to-end generative adversarial network. The geometric map represents 3D shapes symmetrically on a square image grid, while preserving the neighboring relationship of 3D vertices in a local least-square sense. This enables effective learning for the latent representation of data with different attributes. Secondly, we employ a unified and unpaired learning framework for multi-domain attribute translation. It not only makes effective usage of data correlation from multiple domains, but also mitigates the constraint for hardly accessible paired data. Finally, we propose a hierarchical architecture for the discriminator to guarantee robust results against both global and local artifacts. We conduct extensive experiments to demonstrate the advantage of the proposed framework over the state-of-the-art in generating high-fidelity facial shapes. Given an input 3D facial shape, the proposed framework is able to synthesize novel shapes of different attributes, which covers some downstream applications, such as expression transfer, gender translation, and aging. Code at https://github.com/NaughtyZZ/3D_facial_shape_attribute_translation_ssgmap.


title: Model-free Reinforcement Learning with Stochastic Reward Stabilization for Recommender Systems

abstract: Model-free RL-based recommender systems have recently received increasing research attention due to their capability to handle partial feedback and long-term rewards. However, most existing research has ignored a critical feature in recommender systems: one user's feedback on the same item at different times is random. The stochastic rewards property essentially differs from that in classic RL scenarios with deterministic rewards, which makes RL-based recommender systems much more challenging. In this paper, we first demonstrate in a simulator environment where using direct stochastic feedback results in a significant drop in performance. Then to handle the stochastic feedback more efficiently, we design two stochastic reward stabilization frameworks that replace the direct stochastic feedback with that learned by a supervised model. Both frameworks are model-agnostic, i.e., they can effectively utilize various supervised models. We demonstrate the superiority of the proposed frameworks over different RL-based recommendation baselines with extensive experiments on a recommendation simulator as well as an industrial-level recommender system.


title: Oligomorphic groups and ultrahomogeneous cubic spaces over finite fields

abstract: We show that for certain class of oligomorphic groups there is a version of multiplication of double cosets in Ismagilov--Olshanski sense. Categories of (reduced) double cosets are realized as certain categories of partial bijections. As an example, we consider the ultrahomogeneous linear space $\mathcal{Z}$ of countable dimension over a finite field equipped with a cubic form. The group $G$ of automorphisms of $\mathcal{Z}$ is an oligomorphic group, we describe its open subgroups. According Tsankov, this gives a classification of its unitary representations. The category of reduced double cosets is the category of partial linear bijections of finite-dimensional cubic spaces preserving cubic forms.


title: Gravitational waves from metastable cosmic strings in Pati-Salam model in light of new pulsar timing array data

abstract: A series of pulsar timing arrays (PTAs) recently observed gravitational waves at the nanohertz frequencies. Motivated by this remarkable result, we present a novel class of Pati-Salam models that give rise to a network of metastable cosmic strings, offering a plausible explanation for the observed PTA data. Besides, we introduce a hybrid inflationary scenario to eliminate magnetic monopoles that arise during the spontaneous symmetry breaking of the Pati-Salam gauge group to the Standard Model. The resulting scalar spectral index is compatible with Planck data, and the tensor-to-scalar ratio is anticipated to be extremely small. Moreover, we incorporate a non-thermal leptogenesis to generate the required baryon asymmetry in our framework. Finally, the gravitational wave spectra generated by the metastable cosmic strings not only correspond to signals observed in recent PTAs, including NANOGrav, but are also within the exploration capacity of both present and future ground-based and space-based experiments.


title: Learning and Optimization of Implicit Negative Feedback for Industrial Short-video Recommender System

abstract: Short-video recommendation is one of the most important recommendation applications in today's industrial information systems. Compared with other recommendation tasks, the enormous amount of feedback is the most typical characteristic. Specifically, in short-video recommendation, the easiest-to-collect user feedback is the skipping behavior, which leads to two critical challenges for the recommendation model. First, the skipping behavior reflects implicit user preferences, and thus, it is challenging for interest extraction. Second, this kind of special feedback involves multiple objectives, such as total watching time and skipping rate, which is also very challenging. In this paper, we present our industrial solution in Kuaishou, which serves billion-level users every day. Specifically, we deploy a feedback-aware encoding module that extracts user preferences, taking the impact of context into consideration. We further design a multi-objective prediction module which well distinguishes the relation and differences among different model objectives in the short-video recommendation. We conduct extensive online A/B tests, along with detailed and careful analysis, which verify the effectiveness of our solution.


title: TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling

abstract: The identification of sensory cues associated with potential opportunities and dangers is frequently complicated by unrelated events that separate useful cues by long delays. As a result, it remains a challenging task for state-of-the-art spiking neural networks (SNNs) to establish long-term temporal dependency between distant cues. To address this challenge, we propose a novel biologically inspired Two-Compartment Leaky Integrate-and-Fire spiking neuron model, dubbed TC-LIF. The proposed model incorporates carefully designed somatic and dendritic compartments that are tailored to facilitate learning long-term temporal dependencies. Furthermore, a theoretical analysis is provided to validate the effectiveness of TC-LIF in propagating error gradients over an extended temporal duration. Our experimental results, on a diverse range of temporal classification tasks, demonstrate superior temporal classification capability, rapid training convergence, and high energy efficiency of the proposed TC-LIF model. Therefore, this work opens up a myriad of opportunities for solving challenging temporal processing tasks on emerging neuromorphic computing systems. Our code is publicly available at https://github.com/ZhangShimin1/TC-LIF.


title: Constructing and sampling partite, $3$-uniform hypergraphs with given degree sequence

abstract: Partite, $3$-uniform hypergraphs are $3$-uniform hypergraphs in which each hyperedge contains exactly one point from each of the $3$ disjoint vertex classes. We consider the degree sequence problem of partite, $3$-uniform hypergraphs, that is, to decide if such a hypergraph with prescribed degree sequences exists. We prove that this decision problem is NP-complete in general, and give a polynomial running time algorithm for third almost-regular degree sequences, that is, when each degree in one of the vertex classes is $k$ or $k-1$ for some fixed $k$, and there is no restriction for the other two vertex classes. We also consider the sampling problem, that is, to uniformly sample partite, $3$-uniform hypergraphs with prescribed degree sequences. We propose a Parallel Tempering method, where the hypothetical energy of the hypergraphs measures the deviation from the prescribed degree sequence. The method has been implemented and tested on synthetic and real data. It can also be applied for $\chi^2$ testing of contingency tables. We have shown that this hypergraph-based $\chi^2$ test is more sensitive than the standard $\chi^2$ test. The extra sensitivity is especially advantageous on small data sets, where the proposed Parallel Tempering method shows promising performance.


title: Kissing to Find a Match: Efficient Low-Rank Permutation Representation

abstract: Permutation matrices play a key role in matching and assignment problems across the fields, especially in computer vision and robotics. However, memory for explicitly representing permutation matrices grows quadratically with the size of the problem, prohibiting large problem instances. In this work, we propose to tackle the curse of dimensionality of large permutation matrices by approximating them using low-rank matrix factorization, followed by a nonlinearity. To this end, we rely on the Kissing number theory to infer the minimal rank required for representing a permutation matrix of a given size, which is significantly smaller than the problem size. This leads to a drastic reduction in computation and memory costs, e.g., up to $3$ orders of magnitude less memory for a problem of size $n=20000$, represented using $8.4\times10^5$ elements in two small matrices instead of using a single huge matrix with $4\times 10^8$ elements. The proposed representation allows for accurate representations of large permutation matrices, which in turn enables handling large problems that would have been infeasible otherwise. We demonstrate the applicability and merits of the proposed approach through a series of experiments on a range of problems that involve predicting permutation matrices, from linear and quadratic assignment to shape matching problems.


title: Impact of hot exozodiacal dust on the polarimetric analysis of close-in exoplanets

abstract: Hot exozodiacal dust (HEZD) found around main-sequence stars through interferometric observations in the photometric bands H to L is located close to the dust sublimation radius, potentially at orbital radii comparable to those of close-in exoplanets. Consequently, HEZD has a potential influence on the analysis of the scattered-light polarization of close-in exoplanets and vice versa. We analyze the impact of HEZD on the polarimetric characterization of close-in exoplanets. This study is motivated in particular by the recently proven feasibility of exoplanet polarimetry. Applying the 3D Monte Carlo radiative transfer code POLARIS in an extended and optimized version for radiative transfer in exoplanetary atmospheres and an analytical tool for modeling the HEZD, we simulated and compared the polarization characteristics of the wavelength-dependent scattered-light polarization of HEZD and close-in exoplanets. The varied parameters are the planetary phase angle ($0^\circ-180^\circ$), the dust grain radius ($0.02\ \mu$m $- \ 10\ \mu$m), the HEZD mass ($10^{-10}$$\rm{M}_{\oplus}$ $-\ 10^{-8}$$\rm{M}_{\oplus}$), the orbital inclination ($0^\circ-90^\circ$), the composition of the planetary atmosphere (Mie and Rayleigh scattering atmosphere), the orbital radius of the HEZD ($0.02$ au $-\ 0.4$ au), and the planetary orbital radius ($0.01$ au $-\ 0.05$ au). The dust grain radius has the strongest influence on the polarimetric analysis due to its significant impact on the wavelength-dependent polarization characteristics and the total order of magnitude of the scattered-light polarization. In certain scenarios, the scattered-light polarization of the HEZD even exceeds that of the close-in exoplanet.


title: Modified scattering for nonlinear Schr\"odinger equations with long-range potentials

abstract: We study the final state problem for the nonlinear Schr\"{o}dinger equation with a critical long-range nonlinearity and a long-range linear potential. Given a prescribed asymptotic profile which is different from the free evolution, we construct a unique global solution scattering to the profile. In particular, the existence of the modified wave operators is obtained for sufficiently localized small scattering data. The class of potential includes a repulsive long-range potential with a short-range perturbation, especially the positive Coulomb potential in two and three space dimensions. The asymptotic profile is constructed by combining Yafaev's type linear modifier [41] associated with the long-range part of the potential and the nonlinear modifier introduced by Ozawa [32]. Finally, we also show that one can replace Yafaev's type modifier by Dollard's type modifier under a slightly stronger decay assumption on the long-range potential. This is the first positive result on the modified scattering for the nonlinear Schr\"{o}dinger equation in the case when both of the nonlinear term and the linear potential are of long-range type.


title: A lower bound on the multicolor size-Ramsey numbers of paths in hypergraphs

abstract: The $r$-color size-Ramsey number of a $k$-uniform hypergraph $H$, denoted by $\hat{R}_r(H)$, is the minimum number of edges in a $k$-uniform hypergraph $G$ such that for every $r$-coloring of the edges of $G$ there exists a monochromatic copy of $H$. In the case of $2$-uniform paths $P_n$, it is known that $\Omega(r^2n)=\hat{R}_r(P_n)=O((r^2\log r)n)$ with the best bounds essentially due to Krivelevich. In a recent breakthrough result, Letzter, Pokrovskiy, and Yepremyan gave a linear upper bound on the $r$-color size-Ramsey number of the $k$-uniform tight path $P_{n}^{(k)}$; i.e. $\hat{R}_r(P_{n}^{(k)})=O_{r,k}(n)$. Winter gave the first non-trivial lower bounds on the 2-color size-Ramsey number of $P_{n}^{(k)}$ for $k\geq 3$; i.e. $\hat{R}_2(P_{n}^{(3)})\geq \frac{8}{3}n-O(1)$ and $\hat{R}_2(P_{n}^{(k)})\geq \lceil\log_2(k+1)\rceil n-O_k(1)$ for $k\geq 4$. We consider the problem of giving a lower bound on the $r$-color size-Ramsey number of $P_{n}^{(k)}$ (for fixed $k$ and growing $r$). Our main result is that $\hat{R}_r(P_n^{(k)})=\Omega_k(r^kn)$ which generalizes the best known lower bound for graphs mentioned above. One of the key elements of our proof is a determination of the correct order of magnitude of the $r$-color size-Ramsey number of every sufficiently short tight path; i.e. $\hat{R}_r(P_{k+m}^{(k)})=\Theta_k(r^m)$ for all $1\leq m\leq k$. All of our results generalize to $\ell$-overlapping $k$-uniform paths $P_{n}^{(k, \ell)}$. In particular we note that when $1\leq \ell\leq \frac{k}{2}$, we have $\Omega_k(r^{2}n)=\hat{R}_r(P_{n}^{(k, \ell)})=O((r^2\log r)n)$ which essentially matches the best known bounds for graphs mentioned above. Additionally, in the case $k=3$, $\ell=2$, and $r=2$, we give a more precise estimate which implies $\hat{R}_2(P^{(3)}_{n})\geq \frac{28}{9}n-O(1)$, improving on the above-mentioned lower bound of Winter in the case $k=3$.


title: Multiple imputation of partially observed data after treatment-withdrawal

abstract: The ICH E9(R1) Addendum (International Council for Harmonization 2019) suggests treatment-policy as one of several strategies for addressing intercurrent events such as treatment withdrawal when defining an estimand. This strategy requires the monitoring of patients and collection of primary outcome data following termination of randomized treatment. However, when patients withdraw from a study before nominal completion this creates true missing data complicating the analysis. One possible way forward uses multiple imputation to replace the missing data based on a model for outcome on and off treatment prior to study withdrawal, often referred to as retrieved dropout multiple imputation. This article explores a novel approach to parameterizing this imputation model so that those parameters which may be difficult to estimate have mildly informative Bayesian priors applied during the imputation stage. A core reference-based model is combined with a compliance model, using both on- and off- treatment data to form an extended model for the purposes of imputation. This alleviates the problem of specifying a complex set of analysis rules to accommodate situations where parameters which influence the estimated value are not estimable or are poorly estimated, leading to unrealistically large standard errors in the resulting analysis.


title: Alternating Shrinking Higher-order Interactions for Sparse Neural Population Activity

abstract: Neurons in living things work cooperatively and efficiently to process incoming sensory information, often exhibiting sparse and widespread population activity involving structured higher-order interactions. While there are statistical models based on continuous probability distributions for neurons' sparse firing rates, how the spiking activities of a large number of interacting neurons result in the sparse and widespread population activity remains unknown. Here, for homogeneous (0,1) binary neurons, we provide sufficient conditions under which their spike-count population distribution converges to a sparse widespread distribution of the population spike rate in an infinitely large population of neurons. Following the conditions, we propose new models belonging to an exponential family distribution in which the sign and magnitude of neurons' higher-order interactions alternate and shrink as the order increases. The distributions exhibit parameter-dependent sparsity on a bounded support for the population firing rate. The theory serves as a building block for developing prior distributions and neurons' non-linearity for spike-based sparse coding.


title: Intersection numbers with Pixton's class and the noncommutative KdV hierarchy

abstract: The Pixton class is a nonhomogeneous cohomology class on the moduli space of stable curves $\overline{\mathcal{M}}_{g,n}$, with nontrivial terms in degree $0,2,4,\ldots,2g$, whose top degree part coincides with the double ramification cycle. In this paper, we prove our conjecture from a previous work, claiming that the generating series of intersection numbers of the Pixton class with monomials in the psi-classes gives a solution of the noncommutative KdV hierarchy.


title: Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answering

abstract: Equipped with Chain-of-Thought (CoT), Large language models (LLMs) have shown impressive reasoning ability in various downstream tasks. Even so, suffering from hallucinations and the inability to access external knowledge, LLMs often come with incorrect or unfaithful intermediate reasoning steps, especially in the context of answering knowledge-intensive tasks such as KBQA. To alleviate this issue, we propose a framework called Knowledge-Driven Chain-of-Thought (KD-CoT) to verify and modify reasoning traces in CoT via interaction with external knowledge, and thus overcome the hallucinations and error propagation. Concretely, we formulate the CoT rationale process of LLMs into a structured multi-round QA format. In each round, LLMs interact with a QA system that retrieves external knowledge and produce faithful reasoning traces based on retrieved precise answers. The structured CoT reasoning of LLMs is facilitated by our developed KBQA CoT collection, which serves as in-context learning demonstrations and can also be utilized as feedback augmentation to train a robust retriever. Extensive experiments on WebQSP and ComplexWebQuestion datasets demonstrate the effectiveness of proposed KD-CoT in task-solving reasoning generation, which outperforms the vanilla CoT ICL with an absolute success rate of 8.0% and 5.1%. Furthermore, our proposed feedback-augmented retriever outperforms the state-of-the-art baselines for retrieving knowledge, achieving significant improvement in Hit and recall performance. Our code and data are released on https://github.com/AdelWang/KD-CoT/tree/main.


title: Approximation Algorithms to Enhance Social Sharing of Fresh Point-of-Interest Information

abstract: In location-based social networks (LBSNs), such as Gowalla and Waze, users sense urban point-of-interest (PoI) information (e.g., restaurants' queue length and real-time traffic conditions) in the vicinity and share such information with friends in online social networks. Given each user's social connections and the severe lags in disseminating fresh PoI to all users, major LBSNs aim to enhance users' social PoI sharing by selecting $k$ out of $m$ users as hotspots and broadcasting their PoI information to the entire user community. This motivates us to study a new combinatorial optimization problem by integrating two urban sensing and online social networks. We prove that this problem is NP-hard and also renders existing approximation solutions not viable. Through analyzing the interplay effects between the sensing and social networks, we successfully transform the involved PoI-sharing process across two networks to matrix computations for deriving a closed-form objective, {\color{black}which we find holds desirable properties (e.g., submodularity and monotonicity).} This finding enables us to develop a polynomial-time algorithm that guarantees a ($1-\frac{m-2}{m}(\frac{k-1}{k})^k$) approximation of the optimum. Furthermore, we allow each selected user to move around and sense more PoI information to share. To this end, we propose an augmentation-adaptive algorithm, which benefits from a resource-augmented technique and achieves bounded approximation, ranging from $\frac{1}{k}(1-\frac{1}{e})$ to $1-\frac{1}{e}> 0.632$ by adjusting our augmentation factors. Finally, our theoretical results are corroborated by our simulation findings using both synthetic and real-world datasets across different network topologies.


title: Scalar Cosmological Perturbations from Quantum Entanglement within Lorentzian Quantum Gravity

abstract: We derive the dynamics of (isotropic) scalar perturbations from the mean-field hydrodynamics of full Lorentzian quantum gravity, as described by a two-sector (timelike and spacelike) Barrett-Crane group field theory (GFT) model. The rich causal structure of this model allows us to consistently implement in the quantum theory the causal properties of a physical Lorentzian reference frame composed of four minimally coupled, massless, and free scalar fields. Using this frame, we are able to effectively construct relational observables that are used to recover macroscopic cosmological quantities. In particular, small isotropic scalar inhomogeneities emerge as a result of (relational) nearest-neighbor two-body entanglement between degrees of freedom of the underlying quantum gravity theory. The dynamical equations we obtain for geometric and matter perturbations show agreement with those of classical general relativity in the long-wavelength, super-horizon limit. In general, deviations become important for sub-horizon modes, which seem to be naturally associated with a trans-Planckian regime in our physical reference frame. We argue that these trans-Planckian corrections are quantum gravitational in nature. However, we explicitly show that for some physically interesting solutions these quantum gravity effects can be quite small, leading to a very good agreement with the classical GR behavior.


title: Generative Bayesian modeling to nowcast the effective reproduction number from line list data with missing symptom onset dates

abstract: The time-varying effective reproduction number $R_t$ is a widely used indicator of transmission dynamics during infectious disease outbreaks. Timely estimates of $R_t$ can be obtained from observations close to the original date of infection, such as the date of symptom onset. However, these data often have missing information and are subject to right truncation. Previous methods have addressed these problems independently by first imputing missing onset dates, then adjusting truncated case counts, and finally estimating the effective reproduction number. This stepwise approach makes it difficult to propagate uncertainty and can introduce subtle biases during real-time estimation due to the continued impact of assumptions made in previous steps. In this work, we integrate imputation, truncation adjustment, and $R_t$ estimation into a single generative Bayesian model, allowing direct joint inference of case counts and $R_t$ from line list data with missing symptom onset dates. We then use this framework to compare the performance of nowcasting approaches with different stepwise and generative components on synthetic line list data for multiple outbreak scenarios and across different epidemic phases. We find that under long reporting delays, intermediate smoothing, as is common practice in stepwise approaches, can bias nowcasts of case counts and $R_t$, which is avoided in a joint generative approach due to shared regularization of all model components. On incomplete line list data, a fully generative approach enables the quantification of uncertainty due to missing onset dates without the need for an initial multiple imputation step. In a real-world comparison using hospitalization line list data from the COVID-19 pandemic in Switzerland, we observe the same qualitative differences between approaches. Our generative modeling components have been integrated into the R package epinowcast.


title: Ab initio based study on atomic ordering in {(Ba, Sr)}TiO$_3$

abstract: \ We combine density functional theory and molecular dynamics simulations to investigate the impact of Sr concentration and atomic ordering on the structural and ferroelectric properties of (Ba, Sr)TiO$_3$. On one hand, the macroscopic structural properties are rather insensitive to atomic ordering. On the other hand, the Curie temperature and polarization differ by $9$\% and $17$\% for different symmetries of the Sr distribution, respectively. Local ordering of Sr induces preferential polarization directions and influences the relative stability of the three ferroelectric phases.


title: Capacity of infinite graphs over non-Archimedean ordered fields

abstract: In this article we study the notion of capacity of a vertex for infinite graphs over non-Archimedean fields. In contrast to graphs over the real field monotone limits do not need to exist. Thus, in our situation next to positive and null capacity there is a third case of divergent capacity. However, we show that either of these cases is independent of the choice of the vertex and is therefore a global property for connected graphs. The capacity is shown to connect the minimization of the energy, solutions of the Dirichlet problem and existence of a Green's function. We furthermore give sufficient criteria in form of a Nash-Williams test, study the relation to Hardy inequalities and discuss the existence of positive superharmonic functions. Finally, we investigate the analytic features of the transition operator in relation to the inverse of the Laplace operator.


title: Heterogeneous Federated Learning via Personalized Generative Networks

abstract: Federated Learning (FL) allows several clients to construct a common global machine-learning model without having to share their data. FL, however, faces the challenge of statistical heterogeneity between the client's data, which degrades performance and slows down the convergence toward the global model. In this paper, we provide theoretical proof that minimizing heterogeneity between clients facilitates the convergence of a global model for every single client. This becomes particularly important under empirical concept shifts among clients, rather than merely considering imbalanced classes, which have been studied until now. Therefore, we propose a method for knowledge transfer between clients where the server trains client-specific generators. Each generator generates samples for the corresponding client to remove the conflict with other clients' models. Experiments conducted on synthetic and real data, along with a theoretical study, support the effectiveness of our method in constructing a well-generalizable global model by reducing the conflict between local models.


title: Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and Segmentation

abstract: Tracking any given object(s) spatially and temporally is a common purpose in Visual Object Tracking (VOT) and Video Object Segmentation (VOS). Joint tracking and segmentation have been attempted in some studies but they often lack full compatibility of both box and mask in initialization and prediction, and mainly focus on single-object scenarios. To address these limitations, this paper proposes a Multi-object Mask-box Integrated framework for unified Tracking and Segmentation, dubbed MITS. Firstly, the unified identification module is proposed to support both box and mask reference for initialization, where detailed object information is inferred from boxes or directly retained from masks. Additionally, a novel pinpoint box predictor is proposed for accurate multi-object box prediction, facilitating target-oriented representation learning. All target objects are processed simultaneously from encoding to propagation and decoding, as a unified pipeline for VOT and VOS. Experimental results show MITS achieves state-of-the-art performance on both VOT and VOS benchmarks. Notably, MITS surpasses the best prior VOT competitor by around 6% on the GOT-10k test set, and significantly improves the performance of box initialization on VOS benchmarks. The code is available at https://github.com/yoxu515/MITS.


title: Supersensitive phase estimation by thermal light in nonlinear interferometers

abstract: By consensus, estimation of phase delay between interferometer arms may exhibit an error below the standard quantum (shot-noise) limit if the input is an entangled two-mode state, e.g., a N00N state. We show, by contrast, that such super-sensitive phase estimation is achievable by incoherent, e.g., thermal, input in an interferometer with Kerr-nonlinear two-mode coupler. Not less remarkably, the Heisenberg precision bound is attainable and even surpassed in such nonlinear interferometers even for small nonlinear phase-shifts per photon pair or for significant photon loss. Feasible mode couplers with giant Kerr nonlinearity that stems either from dipole-dipole interactions of Rydberg polaritons in a cold atomic gas, or from cavity-enhanced dispersive atom-field interactions, may exploit such effects to substantially advance interferometric phase microscopy using incoherent, faint light sources.


title: In-sector Compressive Beam Alignment for MmWave and THz Radios

abstract: Beam alignment is key in enabling millimeter wave and terahertz radios to achieve their capacity. Due to the use of large arrays in these systems, the common exhaustive beam scanning results in a substantial training overhead. Prior work has addressed this issue, by developing compressive sensing (CS)-based methods which exploit channel sparsity to achieve faster beam alignment. Unfortunately, standard CS techniques employ wide beams and suffer from a low signal-to-noise ratio (SNR) in the channel measurements. To solve this challenge, we develop an IEEE 802.11ad/ay compatible technique that takes an in-sector approach for CS. In our method, the angle domain channel is partitioned into several sectors, and the channel within the best sector is estimated for beam alignment. The essence of our framework lies in the construction of a low-resolution beam codebook to identify the best sector and in the design of the CS matrix for in-sector channel estimation. Our beam codebook illuminates distinct non-overlapping sectors and can be realized with low-resolution phased arrays. We show that the proposed codebook results in a higher received SNR than the state-of-the-art sector sweep codebooks. Furthermore, our optimized CS matrix achieves a better in-sector channel reconstruction than comparable benchmarks.


title: Heterogeneous Decentralized Machine Unlearning with Seed Model Distillation

abstract: As some recent information security legislation endowed users with unconditional rights to be forgotten by any trained machine learning model, personalized IoT service providers have to put unlearning functionality into their consideration. The most straightforward method to unlearn users' contribution is to retrain the model from the initial state, which is not realistic in high throughput applications with frequent unlearning requests. Though some machine unlearning frameworks have been proposed to speed up the retraining process, they fail to match decentralized learning scenarios. In this paper, we design a decentralized unlearning framework called HDUS, which uses distilled seed models to construct erasable ensembles for all clients. Moreover, the framework is compatible with heterogeneous on-device models, representing stronger scalability in real-world applications. Extensive experiments on three real-world datasets show that our HDUS achieves state-of-the-art performance.


title: A Game of Bundle Adjustment -- Learning Efficient Convergence

abstract: Bundle adjustment is the common way to solve localization and mapping. It is an iterative process in which a system of non-linear equations is solved using two optimization methods, weighted by a damping factor. In the classic approach, the latter is chosen heuristically by the Levenberg-Marquardt algorithm on each iteration. This might take many iterations, making the process computationally expensive, which might be harmful to real-time applications. We propose to replace this heuristic by viewing the problem in a holistic manner, as a game, and formulating it as a reinforcement-learning task. We set an environment which solves the non-linear equations and train an agent to choose the damping factor in a learned manner. We demonstrate that our approach considerably reduces the number of iterations required to reach the bundle adjustment's convergence, on both synthetic and real-life scenarios. We show that this reduction benefits the classic approach and can be integrated with other bundle adjustment acceleration methods.


title: Laser Excitation of the 1S-2S Transition in Singly-Ionized Helium

abstract: Precision laser spectroscopy in the extreme ultraviolet of the 1S-2S two-photon transition in singly-ionized helium is a promising route for tests of fundamental physics. We demonstrate laser excitation of this transition in an atomic beam of $^3$He, based on an amplified frequency comb pulse at 790 nm combined with its 25$^{\text{th}}$ harmonic at 32 nm. A clear resonance is observed with a maximum excitation probability of close to 10$^{-4}$ per pulse, and the results are well described by our simulations. This paves the way for high-precision Ramsey-comb spectroscopy of a single helium ion in a Paul trap.


title: Probing inflationary moduli space with gravitational waves

abstract: We investigate the spectrum of gravitational waves arising from primordial inflation in the presence of a string-theoretical higher curvature correction, specifically, the Gauss-Bonnet coupling term for the inflaton (modulus) field. We show that if the modulus field exhibits a wall-crossing like behavior in the moduli space, there can be a period of Gauss-Bonnet coupling term domination during the usual slow-roll. This phenomenon is potentially detectable as the gravitational wave spectrum exhibits a characteristic peak caused by the brief domination of the Gauss-Bonnet coupling term. We explore the possibility of measuring such gravitational waves with pulsar timing array experiments such as NANOGrav, and future space-borne interferometers such as LISA, DECIGO, and Taiji.


title: Bridging the Gap: Fine-to-Coarse Sketch Interpolation Network for High-Quality Animation Sketch Inbetweening

abstract: The 2D animation workflow is typically initiated with the creation of keyframes using sketch-based drawing. Subsequent inbetweens (i.e., intermediate sketch frames) are crafted through manual interpolation for smooth animations, which is a labor-intensive process. Thus, the prospect of automatic animation sketch interpolation has become highly appealing. However, existing video interpolation methods are generally hindered by two key issues for sketch inbetweening: 1) limited texture and colour details in sketches, and 2) exaggerated alterations between two sketch keyframes. To overcome these issues, we propose a novel deep learning method, namely Fine-to-Coarse Sketch Interpolation Network (FC-SIN). This approach incorporates multi-level guidance that formulates region-level correspondence, sketch-level correspondence and pixel-level dynamics. A multi-stream U-Transformer is then devised to characterize sketch inbewteening patterns using these multi-level guides through the integration of both self-attention and cross-attention mechanisms. Additionally, to facilitate future research on animation sketch inbetweening, we constructed a large-scale dataset - STD-12K, comprising 30 sketch animation series in diverse artistic styles. Comprehensive experiments on this dataset convincingly show that our proposed FC-SIN surpasses the state-of-the-art interpolation methods. Our code and dataset will be publicly available.


title: Fortran High-Level Synthesis: Reducing the barriers to accelerating HPC codes on FPGAs

abstract: In recent years the use of FPGAs to accelerate scientific applications has grown, with numerous applications demonstrating the benefit of FPGAs for high performance workloads. However, whilst High Level Synthesis (HLS) has significantly lowered the barrier to entry in programming FPGAs by enabling programmers to use C++, a major challenge is that most often these codes are not originally written in C++. Instead, Fortran is the lingua franca of scientific computing and-so it requires a complex and time consuming initial step to convert into C++ even before considering the FPGA. In this paper we describe work enabling Fortran for AMD Xilinx FPGAs by connecting the LLVM Flang front end to AMD Xilinx's LLVM back end. This enables programmers to use Fortran as a first-class language for programming FPGAs, and as we demonstrate enjoy all the tuning and optimisation opportunities that HLS C++ provides. Furthermore, we demonstrate that certain language features of Fortran make it especially beneficial for programming FPGAs compared to C++. The result of this work is a lowering of the barrier to entry in using FPGAs for scientific computing, enabling programmers to leverage their existing codebase and language of choice on the FPGA directly.


title: Effective tight-binding Hamiltonian for the low-energy electronic structure of the Cu-doped lead apatite and the parent compound

abstract: We examine the origin of the formation of narrow bands in LK-99 (Pb$_{9}$Cu(PO$_4$)$_6$O) and the parent compound without the Cu doping using density functional theory calculations and model Hamiltonian studies. Explicit analytical expressions are given for a nearest-neighbor tight-binding (TB) Hamiltonian in the momentum space for both the parent and the LK-99 compound, which can serve as an effective model to study various quantum phenomena including superconductivity. The parent material is an insulator with the buckle oxygen atom on the stacked triangular lattice forming the topmost bands, well-separated from the remaining oxygen band manifold. The $C_3$ symmetry-driven two-band TB model describes these two bands quite well. These bands survive in the Cu-doped, LK-99, though with drastically altered band dispersion due to the Cu-O interaction. A similar two-band model involving the Cu $xz$ and $yz$ orbitals broadly describes the top two valence bands of LK-99. However, the band dispersions of both the Cu and O bands are much better described by the four-band TB model incorporating the Cu-O interactions on the buckled honeycomb lattice. We comment on the possible mechanisms of superconductivity in LK-99. even though the actual T$_c$ may be much smaller than reported, and suggest that interstitial Cu clusters leading to broad bands might have a role to play


title: Knowledge-Based Version Incompatibility Detection for Deep Learning

abstract: Version incompatibility issues are rampant when reusing or reproducing deep learning models and applications. Existing techniques are limited to library dependency specifications declared in PyPI. Therefore, these techniques cannot detect version issues due to undocumented version constraints or issues involving hardware drivers or OS. To address this challenge, we propose to leverage the abundant discussions of DL version issues from Stack Overflow to facilitate version incompatibility detection. We reformulate the problem of knowledge extraction as a Question-Answering (QA) problem and use a pre-trained QA model to extract version compatibility knowledge from online discussions. The extracted knowledge is further consolidated into a weighted knowledge graph to detect potential version incompatibilities when reusing a DL project. Our evaluation results show that (1) our approach can accurately extract version knowledge with 84% accuracy, and (2) our approach can accurately identify 65% of known version issues in 10 popular DL projects with a high precision (92%), while two state-of-the-art approaches can only detect 29% and 6% of these issues with 33% and 17% precision respectively.


title: Simulating LDPC code Hamiltonians on 2D lattices

abstract: While LDPC codes have been demonstrated with desirable error correcting properties, this has come at a cost of diverging from the geometrical constraints of many hardware platforms. Viewing codes as the groundspace of a Hamiltonian, we consider engineering a simulation Hamiltonian reproducing some relevant features of the code. Techniques from Hamiltonian simulation theory are used to build a simulation of LDPC codes using only 2D nearest-neighbour interactions at the cost of an energy penalty polynomial in the system size. We derive guarantees for the simulation that allows us to approximately reproduce the ground state of the code Hamiltonian, approximating a $[[N, \Omega(\sqrt{N}), \Omega(\sqrt{N})]]$ code in 2D. The key ingredient is a new constructive tool to simulate an $l$-long interaction between two qubits by a 1D chain of $l$ nearest-neighbour interacting qubits using $\mathrm{poly}( l)$ interaction strengths. This is an exponential advantage over the existing gadgets for this routine which facilitates the first $\epsilon$-simulation of \emph{arbitrary sparse} Hamiltonian on $n$ qubits with a Hamiltonian on a 2D lattice of $O(n^2)$ qubits with interaction strengths scaling as $O\left(\mathrm{poly}(n,1/\epsilon)\right)$.


title: Integrating LLMs and Decision Transformers for Language Grounded Generative Quality-Diversity

abstract: Quality-Diversity is a branch of stochastic optimization that is often applied to problems from the Reinforcement Learning and control domains in order to construct repertoires of well-performing policies/skills that exhibit diversity with respect to a behavior space. Such archives are usually composed of a finite number of reactive agents which are each associated to a unique behavior descriptor, and instantiating behavior descriptors outside of that coarsely discretized space is not straight-forward. While a few recent works suggest solutions to that issue, the trajectory that is generated is not easily customizable beyond the specification of a target behavior descriptor. We propose to jointly solve those problems in environments where semantic information about static scene elements is available by leveraging a Large Language Model to augment the repertoire with natural language descriptions of trajectories, and training a policy conditioned on those descriptions. Thus, our method allows a user to not only specify an arbitrary target behavior descriptor, but also provide the model with a high-level textual prompt to shape the generated trajectory. We also propose an LLM-based approach to evaluating the performance of such generative agents. Furthermore, we develop a benchmark based on simulated robot navigation in a 2d maze that we use for experimental validation.


title: Hyperbolic Random Forests

abstract: Hyperbolic space is becoming a popular choice for representing data due to the hierarchical structure - whether implicit or explicit - of many real-world datasets. Along with it comes a need for algorithms capable of solving fundamental tasks, such as classification, in hyperbolic space. Recently, multiple papers have investigated hyperbolic alternatives to hyperplane-based classifiers, such as logistic regression and SVMs. While effective, these approaches struggle with more complex hierarchical data. We, therefore, propose to generalize the well-known random forests to hyperbolic space. We do this by redefining the notion of a split using horospheres. Since finding the globally optimal split is computationally intractable, we find candidate horospheres through a large-margin classifier. To make hyperbolic random forests work on multi-class data and imbalanced experiments, we furthermore outline a new method for combining classes based on their lowest common ancestor and a class-balanced version of the large-margin loss. Experiments on standard and new benchmarks show that our approach outperforms both conventional random forest algorithms and recent hyperbolic classifiers.


title: AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learning

abstract: The atmosphere affects humans in a multitude of ways, from loss of life due to adverse weather effects to long-term social and economic impacts on societies. Computer simulations of atmospheric dynamics are, therefore, of great importance for the well-being of our and future generations. Here, we propose AtmoRep, a novel, task-independent stochastic computer model of atmospheric dynamics that can provide skillful results for a wide range of applications. AtmoRep uses large-scale representation learning from artificial intelligence to determine a general description of the highly complex, stochastic dynamics of the atmosphere from the best available estimate of the system's historical trajectory as constrained by observations. This is enabled by a novel self-supervised learning objective and a unique ensemble that samples from the stochastic model with a variability informed by the one in the historical record. The task-independent nature of AtmoRep enables skillful results for a diverse set of applications without specifically training for them and we demonstrate this for nowcasting, temporal interpolation, model correction, and counterfactuals. We also show that AtmoRep can be improved with additional data, for example radar observations, and that it can be extended to tasks such as downscaling. Our work establishes that large-scale neural networks can provide skillful, task-independent models of atmospheric dynamics. With this, they provide a novel means to make the large record of atmospheric observations accessible for applications and for scientific inquiry, complementing existing simulations based on first principles.

categories: physics.ao-ph cs.AI cs.LG physics.comp-ph


title: A note on joint calibration estimators for totals and quantiles

abstract: In this paper, we combine calibration for population totals proposed by Deville and S\"arndal (1992) with calibration for population quantiles introduced by Harms and Duchesne (2006). We also extend the pseudo-empirical likelihood method proposed by Chen, Sitter, and Wu (2002). This approach extends the calibration equations for totals by adding relevant constraints on quantiles of continuous variables observed in the data. The proposed approach can be easily applied to handle non-response and data integration problems, and results in a single vector of weights. Furthermore, it is a multipurpose solution, i.e. it makes it possible to improve estimates of means, totals and quantiles for a variable of interest in one step. In a limited simulation study, we compare the proposed joint approach with standard calibration, calibration using empirical likelihood and the correctly specified inverse probability weighting estimator. Open source software implementing the proposed method is available.


title: Advancing Distributed AC Optimal Power Flow for Integrated Transmission-Distribution Systems

abstract: This paper introduces a distributed operational solution for coordinating integrated transmission-distribution (ITD) systems regarding data privacy. To tackle the nonconvex challenges of AC optimal power flow (OPF) problems, our research proposes an enhanced version of the Augmented Lagrangian based Alternating Direction Inexact Newton method (ALADIN). This proposed framework incorporates a second-order correction strategy and convexification, thereby enhancing numerical robustness and computational efficiency. The theoretical studies demonstrate that the proposed distributed algorithm operates the ITD systems with a local quadratic convergence guarantee. Extensive simulations on various ITD configurations highlight the superior performance of our distributed approach in terms of convergence speed, computational efficiency, scalability, and adaptability.


title: Tracing obscured galaxy build-up at high redshift using deep radio surveys

abstract: A fundamental question of extra-galactic astronomy that is yet to be fully understood, concerns the evolution of the star formation rate (SFR) and supermassive black hole (SMBH) activity with cosmic time, as well as their interplay and how it impacts galaxy evolution. A primary focus that could shed more light on these questions is the study of merging systems, comprising highly star-forming galaxies (SFGs) and active galactic nuclei (AGN) at the earliest stages of galactic formation. However, it is essential to explore complementary selection methods across multiple wavelengths. The primary objective of this study is to conduct a comprehensive analysis of a sample of high-redshift ($z>3$) far-infrared (far-IR) and radio-emitting galaxies in the highest possible spatial resolution. In order to select the galactic population of our interest, we selected galaxies that present relatively compact radio morphologies at 1.4 GHz as well as a far-IR spectrum that peaks in flux at $\lambda \geq 350 \, \mu m$. For these selection criteria, we used the COSMOS and ECDF-S fields, which provide high spectral and spatial resolution at a multi-wavelength scale. We derived a sample of eight galaxies that were identified either photometrically or spectroscopically at $z>3$ from literature studies and by our team. A thorough investigation of available optical, near-IR, and millimetre (mm) imaging reveals a possible merging scenario in five out of eight cases in our sample. Additionally, available multi-wavelength photometry strongly suggests active star formation at the $10^3 \, M_{\odot}/yr$ level in massive systems co-hosting an active SMBH. Comparison of these results with previous studies, suggests that our selection method preferentially identifies galaxies hosting an active SMBH, as well as a strong SFG component, resulting in high SFR and IR luminosity.


title: Integrability of a Family of Lotka--Volterra Three Species Biological System

abstract: The aim of this study is to analyze the integrability problem of Lotka--Volterra three species biological system. The system which considered in this work is a biological plausibility or a chemical model. The system has a complex dynamical behavior because it is chaotic system. We, first show that the system is a complete integrable when two of the involved parameters in the system are zero. Second, thorough invariant algebraic surfaces and exponential factors, the nonintegrability problems have been investigated. Particularly, we show the non-existence of polynomial, rational, formal series, and Darboux first integrals when parameters are strictly positive.


title: Refine Neutrino Events Reconstruction with BEiT-3

abstract: Neutrino Events Reconstruction has always been crucial for IceCube Neutrino Observatory. In the Kaggle competition "IceCube -- Neutrinos in Deep Ice", many solutions use Transformer. We present ISeeCube, a pure Transformer model based on TorchScale (the backbone of BEiT-3). When having relatively same amount of total trainable parameters, our model outperforms the 2nd place solution. By using TorchScale, the lines of code drop sharply by about 80% and a lot of new methods can be tested by simply adjusting configs. We compared two fundamental models for predictions on a continuous space, regression and classification, trained with MSE Loss and CE Loss respectively. We also propose a new metric, overlap ratio, to evaluate the performance of the model. Since the model is simple enough, it has the potential to be used for more purposes such as energy reconstruction, and many new methods such as combining it with GraphNeT can be tested more easily. The code and pretrained models are available at https://github.com/ChenLi2049/ISeeCube


title: Unsupervised Domain Adaptation for Anatomical Landmark Detection

abstract: Recently, anatomical landmark detection has achieved great progresses on single-domain data, which usually assumes training and test sets are from the same domain. However, such an assumption is not always true in practice, which can cause significant performance drop due to domain shift. To tackle this problem, we propose a novel framework for anatomical landmark detection under the setting of unsupervised domain adaptation (UDA), which aims to transfer the knowledge from labeled source domain to unlabeled target domain. The framework leverages self-training and domain adversarial learning to address the domain gap during adaptation. Specifically, a self-training strategy is proposed to select reliable landmark-level pseudo-labels of target domain data with dynamic thresholds, which makes the adaptation more effective. Furthermore, a domain adversarial learning module is designed to handle the unaligned data distributions of two domains by learning domain-invariant features via adversarial training. Our experiments on cephalometric and lung landmark detection show the effectiveness of the method, which reduces the domain gap by a large margin and outperforms other UDA methods consistently. The code is available at https://github.com/jhb86253817/UDA_Med_Landmark.


title: Efficient Learned Lossless JPEG Recompression

abstract: JPEG is one of the most popular image compression methods. It is beneficial to compress those existing JPEG files without introducing additional distortion. In this paper, we propose a deep learning based method to further compress JPEG images losslessly. Specifically, we propose a Multi-Level Parallel Conditional Modeling (ML-PCM) architecture, which enables parallel decoding in different granularities. First, luma and chroma are processed independently to allow parallel coding. Second, we propose pipeline parallel context model (PPCM) and compressed checkerboard context model (CCCM) for the effective conditional modeling and efficient decoding within luma and chroma components. Our method has much lower latency while achieves better compression ratio compared with previous SOTA. After proper software optimization, we can obtain a good throughput of 57 FPS for 1080P images on NVIDIA T4 GPU. Furthermore, combined with quantization, our approach can also act as a lossy JPEG codec which has obvious advantage over SOTA lossy compression methods in high bit rate (bpp$>0.9$).


title: Star Formation at the Epoch of Reionization with CANUCS: The ages of stellar populations in MACS1149-JD1

abstract: We present measurements of stellar populations properties of a z = 9.1 gravitationally lensed galaxy MACS1149-JD1 using deep JWST NIRISS slitless spectroscopy as well as NIRISS and NIRCam imaging from the CAnadian NIRISS Unbiased Cluster Survey (CANUCS). The galaxy is split into four components. Three magnified (${\mu}$ ~ 17) star-forming components are unresolved, giving intrinsic sizes of < 50pc. In addition, the underlying extended component contains the bulk of the stellar mass, formed the majority of its stars ~ 50Myr earlier than the other three components and is not the site of the most active star formation currently. The NIRISS and NIRCam resolved photometry does not confirm a strong Balmer break previously seen in Spitzer. The NIRISS grism spectrum has been extracted for the entire galaxy and shows a clear continuum and Lyman-break, with no Lyman-${\alpha}$ detected.


title: JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading

abstract: Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been implemented in the context of agent-based models (ABMs), reinforcement learning (RL) environments, and generative models, processing order flows from historical data sets and hand-crafted agents alike. For many applications, there is a requirement for processing multiple books, either for the calibration of ABMs or for the training of RL agents. We showcase the first GPU-enabled LOB simulator designed to process thousands of books in parallel, with a notably reduced per-message processing time. The implementation of our simulator - JAX-LOB - is based on design choices that aim to best exploit the powers of JAX without compromising on the realism of LOB-related mechanisms. We integrate JAX-LOB with other JAX packages, to provide an example of how one may address an optimal execution problem with reinforcement learning, and to share some preliminary results from end-to-end RL training on GPUs.