title: Enhancing Embodied Object Detection through Language-Image Pre-training and Implicit Object Memory

abstract: Deep-learning and large scale language-image training have produced image object detectors that generalise well to diverse environments and semantic classes. However, single-image object detectors trained on internet data are not optimally tailored for the embodied conditions inherent in robotics. Instead, robots must detect objects from complex multi-modal data streams involving depth, localisation and temporal correlation, a task termed embodied object detection. Paradigms such as Video Object Detection (VOD) and Semantic Mapping have been proposed to leverage such embodied data streams, but existing work fails to enhance performance using language-image training. In response, we investigate how an image object detector pre-trained using language-image data can be extended to perform embodied object detection. We propose a novel implicit object memory that uses projective geometry to aggregate the features of detected objects across long temporal horizons. The spatial and temporal information accumulated in memory is then used to enhance the image features of the base detector. When tested on embodied data streams sampled from diverse indoor scenes, our approach improves the base object detector by 3.09 mAP, outperforming alternative external memories designed for VOD and Semantic Mapping. Our method also shows a significant improvement of 16.90 mAP relative to baselines that perform embodied object detection without first training on language-image data, and is robust to sensor noise and domain shift experienced in real-world deployment.


title: On nonnegative invariant quartics in type A

abstract: The equivariant nonnegativity versus sums of squares question has been solved for any infinite series of essential reflection groups but type A. As a first step to a classification, we analyse $A_n$-invariant quartics. We prove that the cones of invariant sums of squares and nonnegative forms are equal if and only if the number of variables is at most 3 or odd.


title: Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos

abstract: Creating controllable 3D human portraits from casual smartphone videos is highly desirable due to their immense value in AR/VR applications. The recent development of 3D Gaussian Splatting (3DGS) has shown improvements in rendering quality and training efficiency. However, it still remains a challenge to accurately model and disentangle head movements and facial expressions from a single-view capture to achieve high-quality renderings. In this paper, we introduce Rig3DGS to address this challenge. We represent the entire scene, including the dynamic subject, using a set of 3D Gaussians in a canonical space. Using a set of control signals, such as head pose and expressions, we transform them to the 3D space with learned deformations to generate the desired rendering. Our key innovation is a carefully designed deformation method which is guided by a learnable prior derived from a 3D morphable model. This approach is highly efficient in training and effective in controlling facial expressions, head positions, and view synthesis across various captures. We demonstrate the effectiveness of our learned deformation through extensive quantitative and qualitative experiments. The project page can be found at http://shahrukhathar.github.io/2024/02/05/Rig3DGS.html


title: Statistical Test for Anomaly Detections by Variational Auto-Encoders

abstract: In this study, we consider the reliability assessment of anomaly detection (AD) using Variational Autoencoder (VAE). Over the last decade, VAE-based AD has been actively studied in various perspective, from method development to applied research. However, when the results of ADs are used in high-stakes decision-making, such as in medical diagnosis, it is necessary to ensure the reliability of the detected anomalies. In this study, we propose the VAE-AD Test as a method for quantifying the statistical reliability of VAE-based AD within the framework of statistical testing. Using the VAE-AD Test, the reliability of the anomaly regions detected by a VAE can be quantified in the form of p-values. This means that if an anomaly is declared when the p-value is below a certain threshold, it is possible to control the probability of false detection to a desired level. Since the VAE-AD Test is constructed based on a new statistical inference framework called selective inference, its validity is theoretically guaranteed in finite samples. To demonstrate the validity and effectiveness of the proposed VAE-AD Test, numerical experiments on artificial data and applications to brain image analysis are conducted.


title: Charge correlator expansion for free fermion negativity

abstract: Logarithmic negativity is a widely used entanglement measure in quantum information theories, which can also be efficiently computed in quantum many-body systems by replica trick or by relating to correlation matrices. In this paper, we demonstrate that in free-fermion systems with conserved charge, R\'enyi and logarithmic negativity can be expanded by connected charge correlators, analogous to the case for entanglement entropy in the context of full counting statistics (FCS). We confirm the rapid convergence of this expansion in random all-connected Hamiltonian through numerical verification, especially for systems with only local hopping. We find that the replica trick that get logarithmic negativity from the limit of R\'enyi negativity is valid in this method only for translational invariant systems. Using this expansion, we analyze the scaling behavior of negativity in extensive free-fermion systems. In particular, in 1+1 dimensional free-fermion systems, we observe that the scaling behavior of negativity from our expansion is consistent with known results from the method with Toeplitz matrix. These findings provide insights into the entanglement properties of free-fermion systems, and demonstrate the efficacy of the expansion approach in studying entanglement measures.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el


title: Learning Granger Causality from Instance-wise Self-attentive Hawkes Processes

abstract: We address the problem of learning Granger causality from asynchronous, interdependent, multi-type event sequences. In particular, we are interested in discovering instance-level causal structures in an unsupervised manner. Instance-level causality identifies causal relationships among individual events, providing more fine-grained information for decision-making. Existing work in the literature either requires strong assumptions, such as linearity in the intensity function, or heuristically defined model parameters that do not necessarily meet the requirements of Granger causality. We propose Instance-wise Self-Attentive Hawkes Processes (ISAHP), a novel deep learning framework that can directly infer the Granger causality at the event instance level. ISAHP is the first neural point process model that meets the requirements of Granger causality. It leverages the self-attention mechanism of the transformer to align with the principles of Granger causality. We empirically demonstrate that ISAHP is capable of discovering complex instance-level causal structures that cannot be handled by classical models. We also show that ISAHP achieves state-of-the-art performance in proxy tasks involving type-level causal discovery and instance-level event type prediction.


title: A Blowup Solution of Multispeed Klein-Gordon System in Space Dimension Two with Small Initial Data

abstract: We find an example to illustrate that the first nondegeneracy condition of (1.2) is actually needed in proving the global exsitence of 2D multispeed Klein-Gordon system with small initial data (See [3]). We construct a collection of special Klein-Gordon dispersive relations and by iterating the corresponding profiles we can find a blowup in finite time.


title: Consistent Joint Decision-Making with Heterogeneous Learning Models

abstract: This paper introduces a novel decision-making framework that promotes consistency among decisions made by diverse models while utilizing external knowledge. Leveraging the Integer Linear Programming (ILP) framework, we map predictions from various models into globally normalized and comparable values by incorporating information about decisions' prior probability, confidence (uncertainty), and the models' expected accuracy. Our empirical study demonstrates the superiority of our approach over conventional baselines on multiple datasets.


title: Theory of parametric resonance for discrete time crystals in fully-connected spin-cavity systems

abstract: We pinpoint the conditions necessary for discrete time crystal (DTC) formation in fully connected spin-cavity systems from the perspective of parametric resonance by mapping these systems onto oscillator like models. We elucidate the role of nonlinearity and dissipation by mapping the periodically driven open Dicke model onto effective linear and nonlinear oscillator models, while we analyze the effect of global symmetry breaking using the Lipkin-Meshkov-Glick model with tunable anisotropy. We show that the system's nonlinearity restrains the dynamics from becoming unbounded when driven resonantly. On the other hand, dissipation keeps the oscillation amplitude of the period-doubling instability fixed, which is a key feature of DTCs. The presence of global symmetry breaking in the absence of driving is found to be crucial in the parametric resonant activation of period-doubling response. We provide analytic predictions for the resonant frequencies and amplitudes leading to DTC formation for both systems using their respective oscillator models.


title: P-adic AdS/CFT on subspaces of the Bruhat-Tits tree

abstract: On two different subspaces of Bruhat-Tits tree, the exact effective actions and two-point functions of deformed CFTs are calculated according to the p-adic version of AdS/CFT. These subspaces are specially chosen such that in the case of $p\equiv3\pmod4$, they can be viewed as a circle and a hyperbola over p-adic numbers when taken to infinities. It is found that two-point functions of CFTs depend on chordal distances of the circle and the hyperbola.


title: On a positive-preserving, energy-stable numerical scheme to mass-action kinetics with detailed balance

abstract: In this paper, we provide a detailed theoretical analysis of the numerical scheme introduced in J. Comput. Phys. 436 (2021) 110253 for the reaction kinetics of a class of chemical reaction networks that satisfies detailed balance condition. In contrast to conventional numerical approximations, which are typically constructed based on ordinary differential equations (ODEs) for the concentrations of all involved species, the scheme is developed using the equations of reaction trajectories, which can be viewed as a generalized gradient flow of physically relevant free energy. The unique solvability, positivity-preserving, and energy-stable properties are proved for the general case involving multiple reactions, under a mild condition on the stoichiometric matrix.


title: Deep Outdated Fact Detection in Knowledge Graphs

abstract: Knowledge graphs (KGs) have garnered significant attention for their vast potential across diverse domains. However, the issue of outdated facts poses a challenge to KGs, affecting their overall quality as real-world information evolves. Existing solutions for outdated fact detection often rely on manual recognition. In response, this paper presents DEAN (Deep outdatEd fAct detectioN), a novel deep learning-based framework designed to identify outdated facts within KGs. DEAN distinguishes itself by capturing implicit structural information among facts through comprehensive modeling of both entities and relations. To effectively uncover latent out-of-date information, DEAN employs a contrastive approach based on a pre-defined Relations-to-Nodes (R2N) graph, weighted by the number of entities. Experimental results demonstrate the effectiveness and superiority of DEAN over state-of-the-art baseline methods.


title: Cooling-Heating Properties of the FRW Universe in Gravity with a Generalized Conformal Scalar Field

abstract: In this paper, within the framework of modified gravity involving a conformal scalar field, we investigate the Joule-Thomson expansion of the FRW universe to identify cooling and heating regions. Notably, we observe that the Joule-Thomson coefficient, denoted as $\mu$, diverges at $R_A=\sqrt{-2\alpha}$ when $\alpha<0$, aligning with the thermodynamic singularity of the FRW universe. Additionally, we determine the inversion temperature and inversion pressure for the FRW universe, and illustrate the characteristics of inversion curves and isenthalpic curves in the $T$-$P$ plane. We compare these findings with results obtained under Einstein gravity, discussing the influence of the modification term on the cooling and heating properties of the FRW universe. This work contributes significantly to a deeper understanding of the formation of cooling and heating regions within the FRW universe, thereby advancing our comprehension of the physical mechanisms that govern the expansion of our universe.


title: Magnon mediated spin pumping by coupled ferrimagnetic garnets heterostructure

abstract: Spin pumping has significant implications for spintronics, providing a mechanism to manipulate and transport spins for information processing. Understanding and harnessing spin currents through spin pumping is critical for the development of efficient spintronic devices. The use of a magnetic insulator with low damping, enhances the signal-to-noise ratio in crucial experiments such as spin-torque ferromagnetic resonance (FMR) and spin pumping. A magnetic insulator coupled with a heavy metal or quantum material offers a more straight forward model system, especially when investigating spin-charge interconversion processes to greater accuracy. This simplicity arises from the absence of unwanted effects caused by conduction electrons unlike in ferromagnetic metals. Here, we investigate the spin pumping in coupled ferrimagnetic (FiM) Y3Fe5O12 (YIG)/Tm3Fe5O12 (TmIG) bilayers combined with heavy-metal (Pt) using the inverse spin Hall effect (ISHE). It is observed that magnon transmission occurs at both of the FiMs FMR positions. The enhancement of spin pumping voltage (Vsp) in the FiM garnet heterostructures is attributed to the strong interfacial exchange coupling between FiMs. The modulation of Vsp is achieved by tuning the bilayer structure. Further, the spin mixing conductance for these coupled systems is found to be 10^18 m^-2. Our findings describe a novel coupled FiM system for the investigation of magnon coupling providing new prospects for magnonic devices.


title: Investigating the Utility of ChatGPT in the Issue Tracking System: An Exploratory Study

abstract: Issue tracking systems serve as the primary tool for incorporating external users and customizing a software project to meet the users' requirements. However, the limited number of contributors and the challenge of identifying the best approach for each issue often impede effective resolution. Recently, an increasing number of developers are turning to AI tools like ChatGPT to enhance problem-solving efficiency. While previous studies have demonstrated the potential of ChatGPT in areas such as automatic program repair, debugging, and code generation, there is a lack of study on how developers explicitly utilize ChatGPT to resolve issues in their tracking system. Hence, this study aims to examine the interaction between ChatGPT and developers to analyze their prevalent activities and provide a resolution. In addition, we assess the code reliability by confirming if the code produced by ChatGPT was integrated into the project's codebase using the clone detection tool NiCad. Our investigation reveals that developers mainly use ChatGPT for brainstorming solutions but often opt to write their code instead of using ChatGPT-generated code, possibly due to concerns over the generation of "hallucinated code", as highlighted in the literature.


title: An Effective Branch-and-Bound Algorithm with New Bounding Methods for the Maximum $s$-Bundle Problem

abstract: The Maximum s-Bundle Problem (MBP) addresses the task of identifying a maximum s-bundle in a given graph. A graph G=(V, E) is called an s-bundle if its vertex connectivity is at least |V|-s, where the vertex connectivity equals the minimum number of vertices whose deletion yields a disconnected or trivial graph. MBP is NP-hard and holds relevance in numerous realworld scenarios emphasizing the vertex connectivity. Exact algorithms for MBP mainly follow the branch-and-bound (BnB) framework, whose performance heavily depends on the quality of the upper bound on the cardinality of a maximum s-bundle and the initial lower bound with graph reduction. In this work, we introduce a novel Partition-based Upper Bound (PUB) that leverages the graph partitioning technique to achieve a tighter upper bound compared to existing ones. To increase the lower bound, we propose to do short random walks on a clique to generate larger initial solutions. Then, we propose a new BnB algorithm that uses the initial lower bound and PUB in preprocessing for graph reduction, and uses PUB in the BnB search process for branch pruning. Extensive experiments with diverse s values demonstrate the significant progress of our algorithm over state-of-the-art BnB MBP algorithms. Moreover, our initial lower bound can also be generalized to other relaxation clique problems.


title: Differentially Private High Dimensional Bandits

abstract: We consider a high-dimensional stochastic contextual linear bandit problem when the parameter vector is $s_{0}$-sparse and the decision maker is subject to privacy constraints under both central and local models of differential privacy. We present PrivateLASSO, a differentially private LASSO bandit algorithm. PrivateLASSO is based on two sub-routines: (i) a sparse hard-thresholding-based privacy mechanism and (ii) an episodic thresholding rule for identifying the support of the parameter $\theta$. We prove minimax private lower bounds and establish privacy and utility guarantees for PrivateLASSO for the central model under standard assumptions.

categories: cs.LG cs.CR cs.SY eess.SY math.OC stat.ML


title: AoSRNet: All-in-One Scene Recovery Networks via Multi-knowledge Integration

abstract: Scattering and attenuation of light in no-homogeneous imaging media or inconsistent light intensity will cause insufficient contrast and color distortion in the collected images, which limits the developments such as vision-driven smart urban, autonomous vehicles, and intelligent robots. In this paper, we propose an all-in-one scene recovery network via multi-knowledge integration (termed AoSRNet) to improve the visibility of imaging devices in typical low-visibility imaging scenes (e.g., haze, sand dust, and low light). It combines gamma correction (GC) and optimized linear stretching (OLS) to create the detail enhancement module (DEM) and color restoration module (CRM). Additionally, we suggest a multi-receptive field extraction module (MEM) to attenuate the loss of image texture details caused by GC nonlinear and OLS linear transformations. Finally, we refine the coarse features generated by DEM, CRM, and MEM through Encoder-Decoder to generate the final restored image. Comprehensive experimental results demonstrate the effectiveness and stability of AoSRNet compared to other state-of-the-art methods. The source code is available at \url{https://github.com/LouisYuxuLu/AoSRNet}.


title: Tame quivers and affine bases II: nonsimply-laced cases

abstract: In [Tame_quivers_and_affine_bases_I], we give a Ringel-Hall algebra approach to the canonical bases in the symmetric affine cases. In this paper, we extend the results to general symmetrizable affine cases by using Ringel-Hall algebras of representations of a valued quiver. We obtain a bar-invariant basis $\mathbf{B}'=\{C(\mathbf{c},t_\lambda)|(\mathbf{c},t_\lambda)\in\mathcal{G}^a\}$ in the generic composition algebra $\mathcal{C}^*$ and prove that $\mathcal{B}'=\mathbf{B}'\sqcup(-\mathbf{B}')$ coincides with Lusztig's signed canonical basis $\mathcal{B}$. Moreover, in type $\tilde{B}_n,\tilde{C}_n$, $\mathbf{B}'$ is the canonical basis $\mathbf{B}$.


title: BotSSCL: Social Bot Detection with Self-Supervised Contrastive Learning

abstract: The detection of automated accounts, also known as "social bots", has been an increasingly important concern for online social networks (OSNs). While several methods have been proposed for detecting social bots, significant research gaps remain. First, current models exhibit limitations in detecting sophisticated bots that aim to mimic genuine OSN users. Second, these methods often rely on simplistic profile features, which are susceptible to manipulation. In addition to their vulnerability to adversarial manipulations, these models lack generalizability, resulting in subpar performance when trained on one dataset and tested on another. To address these challenges, we propose a novel framework for social Bot detection with Self-Supervised Contrastive Learning (BotSSCL). Our framework leverages contrastive learning to distinguish between social bots and humans in the embedding space to improve linear separability. The high-level representations derived by BotSSCL enhance its resilience to variations in data distribution and ensure generalizability. We evaluate BotSSCL's robustness against adversarial attempts to manipulate bot accounts to evade detection. Experiments on two datasets featuring sophisticated bots demonstrate that BotSSCL outperforms other supervised, unsupervised, and self-supervised baseline methods. We achieve approx. 6% and approx. 8% higher (F1) performance than SOTA on both datasets. In addition, BotSSCL also achieves 67% F1 when trained on one dataset and tested with another, demonstrating its generalizability. Lastly, BotSSCL increases adversarial complexity and only allows 4% success to the adversary in evading detection.


title: SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems

abstract: Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential security threats during the MARL deployment need more attention and thorough investigation. Recent research reveals that attackers can rapidly exploit the victim's vulnerabilities, generating adversarial policies that result in the failure of specific tasks. For instance, reducing the winning rate of a superhuman-level Go AI to around 20%. Existing studies predominantly focus on two-player competitive environments, assuming attackers possess complete global state observation. In this study, we unveil, for the first time, the capability of attackers to generate adversarial policies even when restricted to partial observations of the victims in multi-agent competitive environments. Specifically, we propose a novel black-box attack (SUB-PLAY) that incorporates the concept of constructing multiple subgames to mitigate the impact of partial observability and suggests sharing transitions among subpolicies to improve attackers' exploitative ability. Extensive evaluations demonstrate the effectiveness of SUB-PLAY under three typical partial observability limitations. Visualization results indicate that adversarial policies induce significantly different activations of the victims' policy networks. Furthermore, we evaluate three potential defenses aimed at exploring ways to mitigate security threats posed by adversarial policies, providing constructive recommendations for deploying MARL in competitive environments.


title: Probing early phase coarsening in a rapidly quenched Bose gas using off-resonant matter-wave interferometry

abstract: We experimentally investigate the evolution of spatial phase correlations in a rapidly quenched inhomogeneous Bose gas of rubidium using off-resonant matter-wave interferometry. We measure the phase coherence length $\ell$ of the sample and directly probe its increase during the early stage of condensate growth before vortices are formed. Once the vortices are formed stably in the quenched condensate, the measured value of $\ell$ is shown to be linearly proportional to the mean distance between the vortices. These results confirm the presence of phase coarsening prior to vortex formation, which is crucial for a quantitative understanding of the resultant defect density in samples undergoing critical phase transitions.


title: Effects of the strong Breit interaction on the $2s2p$-$1s2s$ transitions of inner shell hole states of Helium-like ions

abstract: We have calculated the transition energies and probabilities of one-electron one photon and one-electron two photon transitions of middle-Z and high-Z He-like ions using the fully relativistic multiconfiguration Dirac-Hartree-Fock method with active space method. The relativistic, electron correlation, Breit and QED effects are systemically taken into account in the present work. Results showcase consistent agreement with the experimental and theoretical data, uncovering intriguing inversion phenomena in One-Electron One-Photon transitions energy, particularly in double-hole states. Theoretical spectra intensities provide valuable insights into high-energy X-ray radiation processes from double \textit{K}-hole states.


title: INSIDE: LLMs' Internal States Retain the Power of Hallucination Detection

abstract: Knowledge hallucination have raised widespread concerns for the security and reliability of deployed LLMs. Previous efforts in detecting hallucinations have been employed at logit-level uncertainty estimation or language-level self-consistency evaluation, where the semantic information is inevitably lost during the token-decoding procedure. Thus, we propose to explore the dense semantic information retained within LLMs' \textbf{IN}ternal \textbf{S}tates for halluc\textbf{I}nation \textbf{DE}tection (\textbf{INSIDE}). In particular, a simple yet effective \textbf{EigenScore} metric is proposed to better evaluate responses' self-consistency, which exploits the eigenvalues of responses' covariance matrix to measure the semantic consistency/diversity in the dense embedding space. Furthermore, from the perspective of self-consistent hallucination detection, a test time feature clipping approach is explored to truncate extreme activations in the internal states, which reduces overconfident generations and potentially benefits the detection of overconfident hallucinations. Extensive experiments and ablation studies are performed on several popular LLMs and question-answering (QA) benchmarks, showing the effectiveness of our proposal.


title: A unified approach to fluctuations of spectral statistics of generalized patterned random matrices

abstract: An $N \times N$ generalized patterned random matrix is a symmetric matrix defined as $A=(x_{L(i,j)}\mathbf{1}_{\Delta}(i,j))$, where $\{x_k; k \in \mathbb{Z}^d\}$ is known as the input sequence, $L:\{1,2,\ldots, N\}^2 \rightarrow \mathbb{Z}^d$ is known as the link function and $\Delta \subseteq \{1,2,\ldots , N\}^2$. In 2008, Bose and Sen showed that under some restrictions on the link function $L$ and for $\Delta = \{1,2,\ldots , N\}^2$, the corresponding patterned matrices always have a sub-Gaussian limiting spectral distribution. Let $N: \mathbb{N} \rightarrow \mathbb{N}$ be a strictly increasing function and $A_{n}=\left(x_{L(i, j)} \mathbf{1}_{\Delta}(i,j) \right)_{i,j=1}^{N(n)}$ be a sequence of generalized patterned matrices. We consider the LES of $A_n/\sqrt{N(n)}$ for the test function $\phi(x)=x^p$, given by $$ \frac{1}{\sqrt{N(n)}} \sum_{i=1}^{N(n)} \lambda_i^p=\eta_p, \mbox{ say}, $$ where $p$ is a positive integer and $\lambda_i$'s are the eigenvalues of $A_n/\sqrt{N(n)}$. Under some restrictions on $L$ and some moment assumptions on input entries, we show that when $p$ is even, $(\eta_p - \mathbb{E} [\eta_p])$ converges in distribution either to a normal distribution or to the degenerate distribution at zero. We show that under further assumptions on $L$, the limit is always a normal distribution. For odd degree monomial test functions, we derive the limiting moments of $\eta_p$ and show that the LES may not converge to a Gaussian distribution. We also study the LES for independent Brownian motion entries. We show that under some assumption on link function, and that if the limiting moment sequence of the LES of the generalized patterned random matrix with independent standard Gaussian entries is M-determinate, then the LES for Brownian motion entries converge to a deterministic real-valued process.


title: Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback

abstract: Recent advancements in large language models have influenced the development of video large multimodal models (VLMMs). The previous approaches for VLMMs involved Supervised Fine-Tuning (SFT) with instruction-tuned datasets, integrating LLM with visual encoders, and adding additional learnable modules. Video and text multimodal alignment remains challenging, primarily due to the deficient volume and quality of multimodal instruction-tune data compared to text-only data. We present a novel alignment strategy that employs multimodal AI system to oversee itself called Reinforcement Learning from AI Feedback (RLAIF), providing self-preference feedback to refine itself and facilitating the alignment of video and text modalities. In specific, we propose context-aware reward modeling by providing detailed video descriptions as context during the generation of preference feedback in order to enrich the understanding of video content. Demonstrating enhanced performance across diverse video benchmarks, our multimodal RLAIF approach, VLM-RLAIF, outperforms existing approaches, including the SFT model. We commit to open-sourcing our code, models, and datasets to foster further research in this area.


title: An invariance constrained deep learning network for PDE discovery

abstract: The discovery of partial differential equations (PDEs) from datasets has attracted increased attention. However, the discovery of governing equations from sparse data with high noise is still very challenging due to the difficulty of derivatives computation and the disturbance of noise. Moreover, the selection principles for the candidate library to meet physical laws need to be further studied. The invariance is one of the fundamental laws for governing equations. In this study, we propose an invariance constrained deep learning network (ICNet) for the discovery of PDEs. Considering that temporal and spatial translation invariance (Galilean invariance) is a fundamental property of physical laws, we filter the candidates that cannot meet the requirement of the Galilean transformations. Subsequently, we embedded the fixed and possible terms into the loss function of neural network, significantly countering the effect of sparse data with high noise. Then, by filtering out redundant terms without fixing learnable parameters during the training process, the governing equations discovered by the ICNet method can effectively approximate the real governing equations. We select the 2D Burgers equation, the equation of 2D channel flow over an obstacle, and the equation of 3D intracranial aneurysm as examples to verify the superiority of the ICNet for fluid mechanics. Furthermore, we extend similar invariance methods to the discovery of wave equation (Lorentz Invariance) and verify it through Single and Coupled Klein-Gordon equation. The results show that the ICNet method with physical constraints exhibits excellent performance in governing equations discovery from sparse and noisy data.


title: Succinct Data Structure for Chordal Graphs with Bounded Vertex Leafage

abstract: We improve the worst-case information theoretic lower bound of Munro and Wu (ISAAC 2018) for $n-$vertex unlabeled chordal graphs when vertex leafage is bounded and leafage is unbounded. The class of unlabeled $k-$vertex leafage chordal graphs that consists of all chordal graphs with vertex leafage at most $k$ and unbounded leafage, denoted $\mathcal{G}_k$, is introduced for the first time. For $k>0$ in $o(n/\log n)$, we obtain a lower bound of $((k-1)n \log n -kn \log k - O(\log n))-$bits on the size of any data structure that encodes a graph in $\mathcal{G}_k$. Further, for every $k-$vertex leafage chordal graph $G$ such that for $k>1$ in $o(n^c), c >0$, we present a $((k-1)n \log n + o(kn \log n))-$bit succinct data structure, constructed using the succinct data structure for path graphs with $kn/2$ vertices. Our data structure supports adjacency query in $O(k \log n)$ time and using additional $2n \log n$ bits, an $O(k^2 d_v \log n + \log^2 n)$ time neighbourhood query where $d_v$ is degree of $v \in V$.


title: Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

abstract: Recent advancements in large language models have sparked interest in their extraordinary and near-superhuman capabilities, leading researchers to explore methods for evaluating and optimizing these abilities, which is called superalignment. In this context, our paper delves into the realm of vision foundation models, focusing on the concept of weak-to-strong generalization, which involves using a weaker model to supervise a stronger one, aiming to enhance the latter's capabilities beyond the former's limits. We introduce a novel and adaptively adjustable loss function for weak-to-strong supervision. Our comprehensive experiments span various scenarios, including few-shot learning, transfer learning, noisy label learning, and common knowledge distillation settings. The results are striking: our approach not only exceeds the performance benchmarks set by strong-to-strong generalization but also surpasses the outcomes of fine-tuning strong models with whole datasets. This compelling evidence underscores the significant potential of weak-to-strong generalization, showcasing its capability to substantially elevate the performance of vision foundation models. The code is available at https://github.com/ggjy/vision_weak_to_strong.


title: Digital Twin Mobility Profiling: A Spatio-Temporal Graph Learning Approach

abstract: With the arrival of the big data era, mobility profiling has become a viable method of utilizing enormous amounts of mobility data to create an intelligent transportation system. Mobility profiling can extract potential patterns in urban traffic from mobility data and is critical for a variety of traffic-related applications. However, due to the high level of complexity and the huge amount of data, mobility profiling faces huge challenges. Digital Twin (DT) technology paves the way for cost-effective and performance-optimised management by digitally creating a virtual representation of the network to simulate its behaviour. In order to capture the complex spatio-temporal features in traffic scenario, we construct alignment diagrams to assist in completing the spatio-temporal correlation representation and design dilated alignment convolution network (DACN) to learn the fine-grained correlations, i.e., spatio-temporal interactions. We propose a digital twin mobility profiling (DTMP) framework to learn node profiles on a mobility network DT model. Extensive experiments have been conducted upon three real-world datasets. Experimental results demonstrate the effectiveness of DTMP.


title: The first robust evidence showing a dark matter density spike around the supermassive black hole in OJ 287

abstract: Black hole dynamics suggests that dark matter would re-distribute near a supermassive black hole to form a density spike. However, no direct evidence of dark matter density spike around a supermassive black hole has been identified. In this letter, we present the first robust evidence showing a dark matter density spike around a supermassive black hole. We revisit the data of the well-known supermassive black hole binary OJ 287 and show that the inclusion of the dynamical friction due to a dark matter density spike around the supermassive black hole can satisfactorily account for the observed orbital decay rate. The derived spike index $\gamma_{\rm sp}=2.351^{+0.032}_{-0.045}$ gives an excellent agreement with the value $\gamma_{\rm sp}=2.333$ predicted by the benchmark model assuming an adiabatically growing supermassive black hole. This provides a strong verification of the canonical theory suggested two decades ago modeling the gravitational interaction between collisionless dark matter and supermassive black holes.


title: Pre-training of Lightweight Vision Transformers on Small Datasets with Minimally Scaled Images

abstract: Can a lightweight Vision Transformer (ViT) match or exceed the performance of Convolutional Neural Networks (CNNs) like ResNet on small datasets with small image resolutions? This report demonstrates that a pure ViT can indeed achieve superior performance through pre-training, using a masked auto-encoder technique with minimal image scaling. Our experiments on the CIFAR-10 and CIFAR-100 datasets involved ViT models with fewer than 3.65 million parameters and a multiply-accumulate (MAC) count below 0.27G, qualifying them as 'lightweight' models. Unlike previous approaches, our method attains state-of-the-art performance among similar lightweight transformer-based architectures without significantly scaling up images from CIFAR-10 and CIFAR-100. This achievement underscores the efficiency of our model, not only in handling small datasets but also in effectively processing images close to their original scale.


title: Enhanced sampling of robust molecular datasets with uncertainty-based collective variables

abstract: Generating a data set that is representative of the accessible configuration space of a molecular system is crucial for the robustness of machine learned interatomic potentials (MLIP). However, the complexity of molecular systems, characterized by intricate potential energy surfaces (PESs) with numerous local minima and energy barriers, presents a significant challenge. Traditional methods of data generation, such as random sampling or exhaustive exploration, are either intractable or may not capture rare, but highly informative configurations. In this study, we propose a method that leverages uncertainty as the collective variable (CV) to guide the acquisition of chemically-relevant data points, focusing on regions of the configuration space where ML model predictions are most uncertain. This approach employs a Gaussian Mixture Model-based uncertainty metric from a single model as the CV for biased molecular dynamics simulations. The effectiveness of our approach in overcoming energy barriers and exploring unseen energy minima, thereby enhancing the data set in an active learning framework, is demonstrated on the alanine dipeptide benchmark system.


title: Intensive Vision-guided Network for Radiology Report Generation

abstract: Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two aspects. First, when extracting image features, most of them neglect multi-view reasoning in vision and model single-view structure of medical images, such as space-view or channel-view. However, clinicians rely on multi-view imaging information for comprehensive judgment in daily clinical diagnosis. Second, when generating reports, they overlook context reasoning with multi-modal information and focus on pure textual optimization utilizing retrieval-based methods. We aim to address these two issues by proposing a model that better simulates clinicians' perspectives and generates more accurate reports. Given the above limitation in feature extraction, we propose a Globally-intensive Attention (GIA) module in the medical image encoder to simulate and integrate multi-view vision perception. GIA aims to learn three types of vision perception: depth view, space view, and pixel view. On the other hand, to address the above problem in report generation, we explore how to involve multi-modal signals to generate precisely matched reports, i.e., how to integrate previously predicted words with region-aware visual content in next word prediction. Specifically, we design a Visual Knowledge-guided Decoder (VKGD), which can adaptively consider how much the model needs to rely on visual information and previously predicted text to assist next word prediction. Hence, our final Intensive Vision-guided Network (IVGN) framework includes a GIA-guided Visual Encoder and the VKGD. Experiments on two commonly-used datasets IU X-Ray and MIMIC-CXR demonstrate the superior ability of our method compared with other state-of-the-art approaches.


title: QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model

abstract: Autonomous agents based on Large Language Models (LLMs) that devise plans and tackle real-world challenges have gained prominence.However, tailoring these agents for specialized domains like quantitative investment remains a formidable task. The core challenge involves efficiently building and integrating a domain-specific knowledge base for the agent's learning process. This paper introduces a principled framework to address this challenge, comprising a two-layer loop.In the inner loop, the agent refines its responses by drawing from its knowledge base, while in the outer loop, these responses are tested in real-world scenarios to automatically enhance the knowledge base with new insights.We demonstrate that our approach enables the agent to progressively approximate optimal behavior with provable efficiency.Furthermore, we instantiate this framework through an autonomous agent for mining trading signals named QuantAgent. Empirical results showcase QuantAgent's capability in uncovering viable financial signals and enhancing the accuracy of financial forecasts.


title: Uniform error bounds of the ensemble transform Kalman filter for infinite-dimensional dynamics with multiplicative covariance inflation

abstract: Data assimilation is a method of uncertainty quantification to estimate the hidden true state by updating the prediction owing to model dynamics with observation data. As a prediction model, we consider a class of nonlinear dynamical systems on Hilbert spaces including the two-dimensional Navier-Stokes equations and the Lorenz '63 and '96 equations. For nonlinear model dynamics, the ensemble Kalman filter (EnKF) is often used to approximate the mean and covariance of the probability distribution with a set of particles called an ensemble. In this paper, we consider a deterministic version of the EnKF known as the ensemble transform Kalman filter (ETKF), performing well even with limited ensemble sizes in comparison to other stochastic implementations of the EnKF. When the ETKF is applied to large-scale systems, an ad-hoc numerical technique called a covariance inflation is often employed to reduce approximation errors. Despite the practical effectiveness of the ETKF, little is theoretically known. The present study aims to establish the theoretical analysis of the ETKF. We obtain that the estimation error of the ETKF with and without the covariance inflation is bounded for any finite time. In particular, the uniform-in-time error bound is obtained when an inflation parameter is chosen appropriately, justifying the effectiveness of the covariance inflation in the ETKF.


title: The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs

abstract: Large language models (LLMs) have recently experienced remarkable progress, where the advent of multi-modal large language models (MLLMs) has endowed LLMs with visual capabilities, leading to impressive performances in various multi-modal tasks. However, those powerful MLLMs such as GPT-4V still fail spectacularly when presented with certain image and text inputs. In this paper, we identify a typical class of inputs that baffles MLLMs, which consist of images that are highly relevant but inconsistent with answers, causing MLLMs to suffer from hallucination. To quantify the effect, we propose CorrelationQA, the first benchmark that assesses the hallucination level given spurious images. This benchmark contains 7,308 text-image pairs across 13 categories. Based on the proposed CorrelationQA, we conduct a thorough analysis on 9 mainstream MLLMs, illustrating that they universally suffer from this instinctive bias to varying degrees. We hope that our curated benchmark and evaluation results aid in better assessments of the MLLMs' robustness in the presence of misleading images. The resource is available in https://github.com/MasaiahHan/CorrelationQA.


title: Virtual Classification: Modulating Domain-Specific Knowledge for Multidomain Crowd Counting

abstract: Multidomain crowd counting aims to learn a general model for multiple diverse datasets. However, deep networks prefer modeling distributions of the dominant domains instead of all domains, which is known as domain bias. In this study, we propose a simple-yet-effective Modulating Domain-specific Knowledge Network (MDKNet) to handle the domain bias issue in multidomain crowd counting. MDKNet is achieved by employing the idea of `modulating', enabling deep network balancing and modeling different distributions of diverse datasets with little bias. Specifically, we propose an Instance-specific Batch Normalization (IsBN) module, which serves as a base modulator to refine the information flow to be adaptive to domain distributions. To precisely modulating the domain-specific information, the Domain-guided Virtual Classifier (DVC) is then introduced to learn a domain-separable latent space. This space is employed as an input guidance for the IsBN modulator, such that the mixture distributions of multiple datasets can be well treated. Extensive experiments performed on popular benchmarks, including Shanghai-tech A/B, QNRF and NWPU, validate the superiority of MDKNet in tackling multidomain crowd counting and the effectiveness for multidomain learning. Code is available at \url{https://github.com/csguomy/MDKNet}.


title: Amoeboid movement utilizes the shape coupled bifurcation of an active droplet to boost ballistic motion

abstract: One of the essential functions of living organisms is spontaneous migration through the deformation of their body, such as crawling, swimming, and walking. Depending on the size of the object, the efficient migratory mode should be altered because the contribution from the inertial and frictional forces acting on the object switches. Although the self-propelling motion characterizing active matter has been extensively studied, it is still elusive how a living cell utilizes the mode switching of the self-propulsion. Here, we studied the migration dynamics of amoeboid movement of free-living amoeba, Amoeba proteus, for starved and vegetative phases, as typified by dynamic and stationary states, respectively. Fourier-mode analysis on the cell shape and migration velocity extracted two characteristic migration modes, which makes a coexistence of amoeboid-swimmer like random motion and the active-droplet like ballistic motion. While the amoeboid-swimmer mode governs random motion, the active-droplet mode performs non-negligible contribution on the migration strength. By employing the symmetry argument of the active-droplet, we discover the supercritical pitchfork bifurcation of the migration velocity due to the symmetry breaking of the cell shape represents the switching manner from the motionless state to the random and the ballistic motions. Our results suggest that sub-mm sized A. proteus utilizes both shape oscillatory migration of deformed-swimmer driven by surface wave and convection based mass transfer, called blebbing, as like as cm-sized active droplet to optimize the movement efficiency.


title: DeMarking: A Defense for Network Flow Watermarking in Real-Time

abstract: The network flow watermarking technique associates the two communicating parties by actively modifying certain characteristics of the stream generated by the sender so that it covertly carries some special marking information. Some curious users communicating with the hidden server as a Tor client may attempt de-anonymization attacks to uncover the real identity of the hidden server by using this technique. This compromises the privacy of the anonymized communication system. Therefore, we propose a defense scheme against flow watermarking. The scheme is based on deep neural networks and utilizes generative adversarial networks to convert the original Inter-Packet Delays (IPD) into new IPDs generated by the model. We also adopt the concept of adversarial attacks to ensure that the detector will produce an incorrect classification when detecting these new IPDs. This approach ensures that these IPDs are considered "clean", effectively covering the potential watermarks. This scheme is effective against time-based flow watermarking techniques.


title: Deep Learning-Based Correction and Unmixing of Hyperspectral Images for Brain Tumor Surgery

abstract: Hyperspectral Imaging (HSI) for fluorescence-guided brain tumor resection enables visualization of differences between tissues that are not distinguishable to humans. This augmentation can maximize brain tumor resection, improving patient outcomes. However, much of the processing in HSI uses simplified linear methods that are unable to capture the non-linear, wavelength-dependent phenomena that must be modeled for accurate recovery of fluorophore abundances. We therefore propose two deep learning models for correction and unmixing, which can account for the nonlinear effects and produce more accurate estimates of abundances. Both models use an autoencoder-like architecture to process the captured spectra. One is trained with protoporphyrin IX (PpIX) concentration labels. The other undergoes semi-supervised training, first learning hyperspectral unmixing self-supervised and then learning to correct fluorescence emission spectra for heterogeneous optical and geometric properties using a reference white-light reflectance spectrum in a few-shot manner. The models were evaluated against phantom and pig brain data with known PpIX concentration; the supervised model achieved Pearson correlation coefficients (R values) between the known and computed PpIX concentrations of 0.997 and 0.990, respectively, whereas the classical approach achieved only 0.93 and 0.82. The semi-supervised approach's R values were 0.98 and 0.91, respectively. On human data, the semi-supervised model gives qualitatively more realistic results than the classical method, better removing bright spots of specular reflectance and reducing the variance in PpIX abundance over biopsies that should be relatively homogeneous. These results show promise for using deep learning to improve HSI in fluorescence-guided neurosurgery.


title: MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstruction

abstract: Monocular SLAM has received a lot of attention due to its simple RGB inputs and the lifting of complex sensor constraints. However, existing monocular SLAM systems are designed for bounded scenes, restricting the applicability of SLAM systems. To address this limitation, we propose MoD-SLAM, the first monocular NeRF-based dense mapping method that allows 3D reconstruction in real-time in unbounded scenes. Specifically, we introduce a Gaussian-based unbounded scene representation approach to solve the challenge of mapping scenes without boundaries. This strategy is essential to extend the SLAM application. Moreover, a depth estimation module in the front-end is designed to extract accurate priori depth values to supervise mapping and tracking processes. By introducing a robust depth loss term into the tracking process, our SLAM system achieves more precise pose estimation in large-scale scenes. Our experiments on two standard datasets show that MoD-SLAM achieves competitive performance, improving the accuracy of the 3D reconstruction and localization by up to 30% and 15% respectively compared with existing state-of-the-art monocular SLAM systems.


title: Misinformation and Polarization around COVID-19 vaccines in France, Germany, and Italy

abstract: The kick-off of vaccination campaigns in Europe, starting in late December 2020, has been followed by the online spread of controversies and conspiracies surrounding vaccine validity and efficacy. We study Twitter discussions in three major European languages (Italian, German, and French) during the vaccination campaign. Moving beyond content analysis to explore the structural aspects of online discussions, our investigation includes an analysis of polarization and the potential formation of echo chambers, revealing nuanced behavioral and topical differences in user interactions across the analyzed countries. Notably, we identify strong anti- and pro-vaccine factions exhibiting heterogeneous temporal polarization patterns in different countries. Through a detailed examination of news-sharing sources, we uncover the widespread use of other media platforms like Telegram and YouTube for disseminating low-credibility information, indicating a concerning trend of diminishing news credibility over time. Our findings on Twitter discussions during the COVID-19 vaccination campaign in major European languages expose nuanced behavioral distinctions, revealing the profound impact of polarization and the emergence of distinct anti-vaccine and pro-vaccine advocates over time.


title: Pathologies of low-Froude free-surface flows over smoothed bodies

abstract: In the study of low-speed or low-Froude flows of a potential gravity-driven fluid past a wave-generating object, the traditional asymptotic expansion in powers of the Froude number predicts a waveless free-surface at every order. This is due to the fact that the waves are, in fact, exponentially small and beyond-all-orders of the naive expansion. The theory of exponential asymptotics indicates that such exponentially-small water waves are switched-on across so-called Stokes lines -- these curves partition the fluid-domain into wave-free regions and regions with waves. In prior studies, Stokes lines are associated with singularities in the flow field such as stagnation points, or corners in submerged objects or rough beds. In this work, we present a smoothed geometry that was recently highlighted by Pethiyagoda et al. [Int. J. Numer. Meth. Fluids. 2018; 86:607--624] as capable of producing waves, yet paradoxically exhibiting no obvious Stokes line insofar as conventional exponential asymptotics theory. In this work, we demonstrate that the Stokes line for this smooth geometry originates from an essential singularity at infinity in the analytic continuation of free-surface quantities. We discuss some of the difficulties in extending the typical methodology of exponential asymptotics to general wave-structure interaction problems with smooth geometries.


title: Unveiling the charge density wave mechanism in vanadium-based Bi-layered kagome metals

abstract: The charge density wave (CDW), as a hallmark of vanadium-based kagome superconductor AV3Sb5 (A = K, Rb, Cs), has attracted intensive attention. However, the fundamental controversy regarding the underlying mechanism of CDW therein persists. Recently, the vanadium-based bi-layered kagome metal ScV6Sn6, reported to exhibit a long-range charge order below 94 K, has emerged as a promising candidate to further clarify this core issue. Here, employing micro-focusing angle-resolved photoemission spectroscopy ({\mu}-ARPES) and first-principles calculations, we systematically studied the unique CDW order in vanadium-based bi-layered kagome metals by comparing ScV6Sn6 with its isostructural counterpart YV6Sn6, which lacks a CDW ground state. Combining ARPES data and the corresponding joint density of states (DOS), we suggest that the VHS nesting mechanism might be invalid in these materials. Besides, in ScV6Sn6, we identified multiple hybridization energy gaps resulting from CDW-induced band folding, along with an anomalous band dispersion, implying a potential electron-phonon coupling driven mechanism underlying the formation of the CDW order. Our finding not only comprehensively maps the electronic structure of V-based bi-layer kagome metals but also provide constructive experimental evidence for the unique origin of CDW in this system.


title: MobileVLM V2: Faster and Stronger Baseline for Vision Language Model

abstract: We introduce MobileVLM V2, a family of significantly improved vision language models upon MobileVLM, which proves that a delicate orchestration of novel architectural design, an improved training scheme tailored for mobile VLMs, and rich high-quality dataset curation can substantially benefit VLMs' performance. Specifically, MobileVLM V2 1.7B achieves better or on-par performance on standard VLM benchmarks compared with much larger VLMs at the 3B scale. Notably, our 3B model outperforms a large variety of VLMs at the 7B+ scale. Our models will be released at https://github.com/Meituan-AutoML/MobileVLM .


title: Magnetic Field Gated and Current Controlled Spintronic Mem-transistor Neuron -based Spiking Neural Networks

abstract: Spintronic devices, such as the domain walls and skyrmions, have shown significant potential for applications in energy-efficient data storage and beyond CMOS computing architectures. In recent years, spiking neural networks have shown more bio-plausibility. Based on the magnetic multilayer spintronic devices, we demonstrate the magnetic field-gated Leaky integrate and fire neuron characteristics for the spiking neural network applications. The LIF characteristics are controlled by the current pulses, which drive the domain wall, and an external magnetic field is used as the bias to tune the firing properties of the neuron. Thus, the device works like a gate-controlled LIF neuron, acting like a spintronic Mem-Transistor device. We develop a LIF neuron model based on the measured characteristics to show the device integration in the system-level SNNs. We extend the study and propose a scaled version of the demonstrated device with a multilayer spintronic domain wall magnetic tunnel junction as a LIF neuron. using the combination of SOT and the variation of the demagnetization energy across the thin film, the modified leaky integrate and fire LIF neuron characteristics are realized in the proposed devices. The neuron device characteristics are modeled as the modified LIF neuron model. Finally, we integrate the measured and simulated neuron models in the 3-layer spiking neural network and convolutional spiking neural network CSNN framework to test these spiking neuron models for classification of the MNIST and FMNIST datasets. In both architectures, the network achieves classification accuracy above 96%. Considering the good system-level performance, mem-transistor properties, and promise for scalability. The presented devices show an excellent properties for neuromorphic computing applications.


title: DC current generation by dielectric loss in ferroelectrics

abstract: We study dc current generation induced by microwave irradiation to ferroelectric materials. The dc current generation originates from microwave absorption called dielectric loss due to the delay of dielectric response. Such current generation can be formulated as the low-frequency limit of the phonon shift current which arises from an increase of electric polarization accompanying photoexcitation of phonons due to the electron-phonon coupling. To study the dc current generation by the dielectric loss, we apply the diagrammatic treatment of nonlinear optical responses to photoexcitations of phonons and derive the general formula for phonon shift current. We then study the dc current generation in the low-frequency region and find that the dc current scales as $\propto w^2$ for the linearly polarized light and time reversal symmetric systems. We estimate the order of magnitude of the dc current generation by dielectric loss, indicating its feasibility for experimental detection in the GHz region.


title: AttackNet: Enhancing Biometric Security via Tailored Convolutional Neural Network Architectures for Liveness Detection

abstract: Biometric security is the cornerstone of modern identity verification and authentication systems, where the integrity and reliability of biometric samples is of paramount importance. This paper introduces AttackNet, a bespoke Convolutional Neural Network architecture, meticulously designed to combat spoofing threats in biometric systems. Rooted in deep learning methodologies, this model offers a layered defense mechanism, seamlessly transitioning from low-level feature extraction to high-level pattern discernment. Three distinctive architectural phases form the crux of the model, each underpinned by judiciously chosen activation functions, normalization techniques, and dropout layers to ensure robustness and resilience against adversarial attacks. Benchmarking our model across diverse datasets affirms its prowess, showcasing superior performance metrics in comparison to contemporary models. Furthermore, a detailed comparative analysis accentuates the model's efficacy, drawing parallels with prevailing state-of-the-art methodologies. Through iterative refinement and an informed architectural strategy, AttackNet underscores the potential of deep learning in safeguarding the future of biometric security.


title: Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes

abstract: In Federated Learning (FL) paradigm, a parameter server (PS) concurrently communicates with distributed participating clients for model collection, update aggregation, and model distribution over multiple rounds, without touching private data owned by individual clients. FL is appealing in preserving data privacy; yet the communication between the PS and scattered clients can be a severe bottleneck. Model compression algorithms, such as quantization and sparsification, have been suggested but they generally assume a fixed code length, which does not reflect the heterogeneity and variability of model updates. In this paper, through both analysis and experiments, we show strong evidences that variable-length is beneficial for compression in FL. We accordingly present Fed-CVLC (Federated Learning Compression with Variable-Length Codes), which fine-tunes the code length in response of the dynamics of model updates. We develop optimal tuning strategy that minimizes the loss function (equivalent to maximizing the model utility) subject to the budget for communication. We further demonstrate that Fed-CVLC is indeed a general compression design that bridges quantization and sparsification, with greater flexibility. Extensive experiments have been conducted with public datasets to demonstrate that Fed-CVLC remarkably outperforms state-of-the-art baselines, improving model utility by 1.50%-5.44%, or shrinking communication traffic by 16.67%-41.61%.


abstract: In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative rewards to obtain the optimal policy. However, in many real-world scenarios, immediate reward signals are not obtainable; instead, agents receive a single reward that is contingent upon a partial sequence or a complete trajectory. In this work, we define this challenging problem as Reinforcement Learning from Bagged Reward (RLBR), where sequences of data are treated as bags with non-Markovian bagged rewards. We provide a theoretical study to establish the connection between RLBR and standard RL in Markov Decision Processes (MDPs). To effectively explore the reward distributions within these bags and enhance policy training, we propose a Transformer-based reward model, the Reward Bag Transformer, which employs a bidirectional attention mechanism to interpret contextual nuances and temporal dependencies within each bag. Our empirical evaluations reveal that the challenge intensifies as the bag length increases, leading to the performance degradation due to reduced informational granularity. Nevertheless, our approach consistently outperforms existing methods, demonstrating the least decline in efficacy across varying bag lengths and excelling in approximating the original MDP's reward distribution.


title: Fundamental Limits of Two-Hop MIMO Channels: An Asymptotic Approach

abstract: Multi-antenna relays and intelligent reflecting surfaces (IRSs) have been utilized to construct favorable channels to improve the performance of wireless systems. A common feature between relay systems and IRS-aided systems is the two-hop multiple-input multiple-output (MIMO) channel. As a result, the mutual information (MI) of two-hop MIMO channels has been widely investigated with very engaging results. However, a rigorous investigation on the fundamental limits of two-hop MIMO channels, i.e., the first and second-order analysis, is not yet available in the literature, due to the difficulties caused by the two-hop (product) channel and the noise introduced by the relay (active IRS). In this paper, we employ large-scale random matrix theory (RMT), specifically Gaussian tools, to derive the closed-form deterministic approximation for the mean and variance of the MI. Additionally, we determine the convergence rate for the mean, variance and the characteristic function of the MI, and prove the asymptotic Gaussianity. Furthermore, we also investigate the analytical properties of the fundamental equations that describe the closed-form approximation and prove the existence and uniqueness of the solution. An iterative algorithm is then proposed to obtain the solution for the fundamental equations. Numerical results validate the accuracy of the theoretical analysis.


title: Encoding Version History Context for Better Code Representation

abstract: With the exponential growth of AI tools that generate source code, understanding software has become crucial. When developers comprehend a program, they may refer to additional contexts to look for information, e.g. program documentation or historical code versions. Therefore, we argue that encoding this additional contextual information could also benefit code representation for deep learning. Recent papers incorporate contextual data (e.g. call hierarchy) into vector representation to address program comprehension problems. This motivates further studies to explore additional contexts, such as version history, to enhance models' understanding of programs. That is, insights from version history enable recognition of patterns in code evolution over time, recurring issues, and the effectiveness of past solutions. Our paper presents preliminary evidence of the potential benefit of encoding contextual information from the version history to predict code clones and perform code classification. We experiment with two representative deep learning models, ASTNN and CodeBERT, to investigate whether combining additional contexts with different aggregations may benefit downstream activities. The experimental result affirms the positive impact of combining version history into source code representation in all scenarios; however, to ensure the technique performs consistently, we need to conduct a holistic investigation on a larger code base using different combinations of contexts, aggregation, and models. Therefore, we propose a research agenda aimed at exploring various aspects of encoding additional context to improve code representation and its optimal utilisation in specific situations.


title: Learning a Decision Tree Algorithm with Transformers

abstract: Decision trees are renowned for their interpretability capability to achieve high predictive performance, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data at every node in a tree. However, identifying the best partition is challenging, as decision trees optimized for local segments may not bring global generalization. To address this, we introduce MetaTree, which trains a transformer-based model on filtered outputs from classical algorithms to produce strong decision trees for classification. Specifically, we fit both greedy decision trees and optimized decision trees on a large number of datasets. We then train MetaTree to produce the trees that achieve strong generalization performance. This training enables MetaTree to not only emulate these algorithms, but also to intelligently adapt its strategy according to the context, thereby achieving superior generalization performance.


title: Entropy and multifractality in ring-like and jet-like events produced in 11.6A GeV/c $^{197}$Au-AgBr collisions

abstract: Physical quantities such as, entropy, dimensions and multifractal characteristics of multiplicity distributions of charged particles produced in $^{197}$Au-AgBr collisions are examined and the findings are compared with the predictions of Monte Carlo model URQMD (Ultra-Relativistic Quantum Molecular Dynamics) and HIJING (Heavy Ion Jet INteraction Generator) and also with the results reported earlier in hadron-hadron and nucleus-nucleus collisions at different energies. Based on their azimuth distribution, the charged particles produced within narrow-bins exhibit two kinds of substructures, namely, ring-like and jet-like substructures. Thus, on applying the suitable criteria the two different types of events are identified and analyzed separately. It is observed that the maximum entropy production occurs around a narrow mid-rapidity region. The analyses of ring-like and jet-like events suggest that the entropy production is much larger in ring-like events as compared to that in jet-like events. Furthermore, Renyi's order-q information entropy is used to estimate the multifractal specific heat and to construct the spectrum of scaling indices. The findings reveal that the value of multifractal specific heat is higher in ring-like events as compared to that in jet-like events. The studies of generalized dimension and multifractal spectrum indicate that the multifractality is rather, more pronounced in ring-like events as compared to jet-like events. Various features of the experimental data are noticed to be nicely reproduced by the URQMD model


title: Large Language Models As MOOCs Graders

abstract: Massive open online courses (MOOCs) unlock the doors to free education for anyone around the globe with access to a computer and the internet. Despite this democratization of learning, the massive enrollment in these courses means it is almost impossible for one instructor to assess every student's writing assignment. As a result, peer grading, often guided by a straightforward rubric, is the method of choice. While convenient, peer grading often falls short in terms of reliability and validity. In this study, using 18 distinct settings, we explore the feasibility of leveraging large language models (LLMs) to replace peer grading in MOOCs. Specifically, we focus on two state-of-the-art LLMs: GPT-4 and GPT-3.5, across three distinct courses: Introductory Astronomy, Astrobiology, and the History and Philosophy of Astronomy. To instruct LLMs, we use three different prompts based on a variant of the zero-shot chain-of-thought (Zero-shot-CoT) prompting technique: Zero-shot-CoT combined with instructor-provided correct answers; Zero-shot-CoT in conjunction with both instructor-formulated answers and rubrics; and Zero-shot-CoT with instructor-offered correct answers and LLM-generated rubrics. Our results show that Zero-shot-CoT, when integrated with instructor-provided answers and rubrics, produces grades that are more aligned with those assigned by instructors compared to peer grading. However, the History and Philosophy of Astronomy course proves to be more challenging in terms of grading as opposed to other courses. Finally, our study reveals a promising direction for automating grading systems for MOOCs, especially in subjects with well-defined rubrics.


title: Improving Automated Code Reviews: Learning from Experience

abstract: Modern code review is a critical quality assurance process that is widely adopted in both industry and open source software environments. This process can help newcomers learn from the feedback of experienced reviewers; however, it often brings a large workload and stress to reviewers. To alleviate this burden, the field of automated code reviews aims to automate the process, teaching large language models to provide reviews on submitted code, just as a human would. A recent approach pre-trained and fine-tuned the code intelligent language model on a large-scale code review corpus. However, such techniques did not fully utilise quality reviews amongst the training data. Indeed, reviewers with a higher level of experience or familiarity with the code will likely provide deeper insights than the others. In this study, we set out to investigate whether higher-quality reviews can be generated from automated code review models that are trained based on an experience-aware oversampling technique. Through our quantitative and qualitative evaluation, we find that experience-aware oversampling can increase the correctness, level of information, and meaningfulness of reviews generated by the current state-of-the-art model without introducing new data. The results suggest that a vast amount of high-quality reviews are underutilised with current training strategies. This work sheds light on resource-efficient ways to boost automated code review models.


title: All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation

abstract: In this work, we present numerical results concerning an integrated photonic non-linear activation function that relies on a power independent, non-linear phase to amplitude conversion in a passive optical resonator. The underlying mechanism is universal to all optical filters, whereas here, simulations were based on micro-ring resonators (MRRs). Investigation revealed that the photonic neural node can be tuned to support a wide variety of continuous activation functions that are relevant to the neural network architectures, such as the sigmoid and the softplus functions. The proposed photonic node is numerically evaluated in the context of time delayed reservoir computing (TDRC) scheme, targeting the one-step ahead prediction of the Santa Fe series. The proposed phase to amplitude TDRC is benchmarked versus the conventional amplitude based TDRC, showcasing a performance boost by one order of magnitude.


title: EERO: Early Exit with Reject Option for Efficient Classification with limited budget

abstract: The increasing complexity of advanced machine learning models requires innovative approaches to manage computational resources effectively. One such method is the Early Exit strategy, which allows for adaptive computation by providing a mechanism to shorten the processing path for simpler data instances. In this paper, we propose EERO, a new methodology to translate the problem of early exiting to a problem of using multiple classifiers with reject option in order to better select the exiting head for each instance. We calibrate the probabilities of exiting at the different heads using aggregation with exponential weights to guarantee a fixed budget .We consider factors such as Bayesian risk, budget constraints, and head-specific budget consumption. Experimental results, conducted using a ResNet-18 model and a ConvNext architecture on Cifar and ImageNet datasets, demonstrate that our method not only effectively manages budget allocation but also enhances accuracy in overthinking scenarios.


title: Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification

abstract: This paper investigates the language of propaganda and its stylistic features. It presents the PPN dataset, standing for Propagandist Pseudo-News, a multisource, multilingual, multimodal dataset composed of news articles extracted from websites identified as propaganda sources by expert agencies. A limited sample from this set was randomly mixed with papers from the regular French press, and their URL masked, to conduct an annotation-experiment by humans, using 11 distinct labels. The results show that human annotators were able to reliably discriminate between the two types of press across each of the labels. We propose different NLP techniques to identify the cues used by the annotators, and to compare them with machine classification. They include the analyzer VAGO to measure discourse vagueness and subjectivity, a TF-IDF to serve as a baseline, and four different classifiers: two RoBERTa-based models, CATS using syntax, and one XGBoost combining syntactic and semantic features.


title: MolTC: Towards Molecular Relational Modeling In Language Models

abstract: Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for their vast knowledge repositories and advanced logical inference capabilities, has emerged as a promising way for efficient and effective MRL. Despite their potential, these methods predominantly rely on the textual data, thus not fully harnessing the wealth of structural information inherent in molecular graphs. Moreover, the absence of a unified framework exacerbates the issue of information underutilization, as it hinders the sharing of interaction mechanism learned across diverse datasets. To address these challenges, this work proposes a novel LLM-based multi-modal framework for Molecular inTeraction prediction following Chain-of-Thought (CoT) theory, termed MolTC, which effectively integrate graphical information of two molecules in pair. To train MolTC efficiently, we introduce a Multi-hierarchical CoT concept to refine its training paradigm, and conduct a comprehensive Molecular Interactive Instructions dataset for the development of biochemical LLMs involving MRL. Our experiments, conducted across various datasets involving over 4,000,000 molecular pairs, exhibit the superiority of our method over current GNN and LLM-based baselines. Code is available at https://github.com/MangoKiller/MolTC.


title: Soft Prompt Tuning for Cross-Lingual Transfer: When Less is More

abstract: Soft Prompt Tuning (SPT) is a parameter-efficient method for adapting pre-trained language models (PLMs) to specific tasks by inserting learnable embeddings, or soft prompts, at the input layer of the PLM, without modifying its parameters. This paper investigates the potential of SPT for cross-lingual transfer. Unlike previous studies on SPT for cross-lingual transfer that often fine-tune both the soft prompt and the model parameters, we adhere to the original intent of SPT by keeping the model parameters frozen and only training the soft prompt. This does not only reduce the computational cost and storage overhead of full-model fine-tuning, but we also demonstrate that this very parameter efficiency intrinsic to SPT can enhance cross-lingual transfer performance to linguistically distant languages. Moreover, we explore how different factors related to the prompt, such as the length or its reparameterization, affect cross-lingual transfer performance.


title: Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning

abstract: Most advances in medical image recognition supporting clinical auxiliary diagnosis meet challenges due to the low-resource situation in the medical field, where annotations are highly expensive and professional. This low-resource problem can be alleviated by leveraging the transferable representations of large-scale pre-trained vision-language models via relevant medical text prompts. However, existing pre-trained vision-language models require domain experts to carefully design the medical prompts, which greatly increases the burden on clinicians. To address this problem, we propose a weakly supervised prompt learning method MedPrompt to automatically generate medical prompts, which includes an unsupervised pre-trained vision-language model and a weakly supervised prompt learning model. The unsupervised pre-trained vision-language model utilizes the natural correlation between medical images and corresponding medical texts for pre-training, without any manual annotations. The weakly supervised prompt learning model only utilizes the classes of images in the dataset to guide the learning of the specific class vector in the prompt, while the learning of other context vectors in the prompt requires no manual annotations for guidance. To the best of our knowledge, this is the first model to automatically generate medical prompts. With these prompts, the pre-trained vision-language model can be freed from the strong expert dependency of manual annotation and manual prompt design. Experimental results show that the model using our automatically generated prompts outperforms its full-shot learning hand-crafted prompts counterparts with only a minimal number of labeled samples for few-shot learning, and reaches superior or comparable accuracy on zero-shot image classification. The proposed prompt generator is lightweight and therefore can be embedded into any network architecture.


title: AirPhyNet: Harnessing Physics-Guided Neural Networks for Air Quality Prediction

abstract: Air quality prediction and modelling plays a pivotal role in public health and environment management, for individuals and authorities to make informed decisions. Although traditional data-driven models have shown promise in this domain, their long-term prediction accuracy can be limited, especially in scenarios with sparse or incomplete data and they often rely on black-box deep learning structures that lack solid physical foundation leading to reduced transparency and interpretability in predictions. To address these limitations, this paper presents a novel approach named Physics guided Neural Network for Air Quality Prediction (AirPhyNet). Specifically, we leverage two well-established physics principles of air particle movement (diffusion and advection) by representing them as differential equation networks. Then, we utilize a graph structure to integrate physics knowledge into a neural network architecture and exploit latent representations to capture spatio-temporal relationships within the air quality data. Experiments on two real-world benchmark datasets demonstrate that AirPhyNet outperforms state-of-the-art models for different testing scenarios including different lead time (24h, 48h, 72h), sparse data and sudden change prediction, achieving reduction in prediction errors up to 10%. Moreover, a case study further validates that our model captures underlying physical processes of particle movement and generates accurate predictions with real physical meaning.


title: Weakly Supervised Anomaly Detection via Knowledge-Data Alignment

abstract: Anomaly detection (AD) plays a pivotal role in numerous web-based applications, including malware detection, anti-money laundering, device failure detection, and network fault analysis. Most methods, which rely on unsupervised learning, are hard to reach satisfactory detection accuracy due to the lack of labels. Weakly Supervised Anomaly Detection (WSAD) has been introduced with a limited number of labeled anomaly samples to enhance model performance. Nevertheless, it is still challenging for models, trained on an inadequate amount of labeled data, to generalize to unseen anomalies. In this paper, we introduce a novel framework Knowledge-Data Alignment (KDAlign) to integrate rule knowledge, typically summarized by human experts, to supplement the limited labeled data. Specifically, we transpose these rules into the knowledge space and subsequently recast the incorporation of knowledge as the alignment of knowledge and data. To facilitate this alignment, we employ the Optimal Transport (OT) technique. We then incorporate the OT distance as an additional loss term to the original objective function of WSAD methodologies. Comprehensive experimental results on five real-world datasets demonstrate that our proposed KDAlign framework markedly surpasses its state-of-the-art counterparts, achieving superior performance across various anomaly types.


title: High sampling rate single-pixel digital holography system employing a DMD and phase-encoded patterns

abstract: A single-pixel digital holography system with phase-encoded illumination using a digital micromirror device (DMD) as a spatial light modulator (SLM) is presented. The enhanced switching rate of DMDs, far exceeding the stringent frame-rate of liquid crystal SLMs, allows recording and reconstruction of complex amplitude distributions in just a few seconds. A single amplitude binary modulation device is used for concurrently displaying the phase-encoded sampling patterns, compensating the distortion of the wavefront, and applying phase-shifting, by means of computer generated holograms. Our detection system consists of a simple photodiode that sequentially records the irradiance fluctuations corresponding to the interference between object and reference beams. The system recovers phase and amplitude information even when a diffuser is placed in front of the photodiode.


title: The beltway problem over orthogonal groups

abstract: The classical beltway problem entails recovering a set of points from their unordered pairwise distances on the circle. This problem can be viewed as a special case of the crystallographic phase retrieval problem of recovering a sparse signal from its periodic autocorrelation. Based on this interpretation, and motivated by cryo-electron microscopy, we suggest a natural generalization to orthogonal groups: recovering a sparse signal, up to an orthogonal transformation, from its autocorrelation over the orthogonal group. If the support of the signal is collision-free, we bound the number of solutions to the beltway problem over orthogonal groups, and prove that this bound is exactly one when the support of the signal is radially collision-free (i.e., the support points have distinct magnitudes). We also prove that if the pairwise products of the signal's weights are distinct, then the autocorrelation determines the signal uniquely, up to an orthogonal transformation. We conclude the paper by considering binary signals and show that in this case, the collision-free condition need not be sufficient to determine signals up to orthogonal transformation.


title: Symmetry reductions of a generalized Kuramoto-Sivashinsky equation via equivalence transformations

abstract: In this paper we consider a generalized Kuramoto-Sivashinsky equation. The equivalence group of the class under consideration has been constructed. This group allows us to perform a comprehensive study and a clear and concise formulation of the results. We have constructed the optimal system of subalgebras of the projections of the equivalence algebra on the space formed by the dependent variable and the arbitrary functions. By using this optimal system, all nonequivalent equations admitting an extension by one of the principal Lie algebra of the class under consideration can be determined. Taking into account the additional symmetries obtained we reduce some partial differential equations belonging to the class into ordinary differential equations. We derive some exact solutions of these equations.


title: Scalable Parallel Algorithm for Graph Neural Network Interatomic Potentials in Molecular Dynamics Simulations

abstract: Message-passing graph neural network interatomic potentials (GNN-IPs), particularly those with equivariant representations such as NequIP, are attracting significant attention due to their data efficiency and high accuracy. However, parallelizing GNN-IPs poses challenges because multiple message-passing layers complicate data communication within the spatial decomposition method, which is preferred by many molecular dynamics (MD) packages. In this article, we propose an efficient parallelization scheme compatible with GNN-IPs and develop a package, SevenNet (Scalable EquiVariance-Enabled Neural NETwork), based on the NequIP architecture. For MD simulations, SevenNet interfaces with the LAMMPS package. Through benchmark tests on a 32-GPU cluster with examples of SiO$_2$, SevenNet achieves over 80% parallel efficiency in weak-scaling scenarios and exhibits nearly ideal strong-scaling performance as long as GPUs are fully utilized. However, the strong-scaling performance significantly declines with suboptimal GPU utilization, particularly affecting parallel efficiency in cases involving lightweight models or simulations with small numbers of atoms. We also pre-train SevenNet with a vast dataset from the Materials Project (dubbed `SevenNet-0') and assess its performance on generating amorphous Si$_3$N$_4$ containing more than 100,000 atoms. By developing scalable GNN-IPs, this work aims to bridge the gap between advanced machine learning models and large-scale MD simulations, offering researchers a powerful tool to explore complex material systems with high accuracy and efficiency.


title: Strong approximation of the time-fractional Cahn--Hilliard equation driven by a fractionally integrated additive noise

abstract: In this paper, we consider the numerical approximation of a time-fractional stochastic Cahn--Hilliard equation driven by an additive fractionally integrated Gaussian noise. The model involves a Caputo fractional derivative in time of order $\alpha\in(0,1)$ and a fractional time-integral noise of order $\gamma\in[0,1]$. The numerical scheme approximates the model by a piecewise linear finite element method in space and a convolution quadrature in time (for both time-fractional operators), along with the $L^2$-projection for the noise. We carefully investigate the spatially semidiscrete and fully discrete schemes, and obtain strong convergence rates by using clever energy arguments. The temporal H\"older continuity property of the solution played a key role in the error analysis. Unlike the stochastic Allen--Cahn equation, the presence of the unbounded elliptic operator in front of the cubic nonlinearity in the underlying model adds complexity and challenges to the error analysis. To overcome these difficulties, several new techniques and error estimates are developed. The study concludes with numerical examples that validate the theoretical findings.


title: ZeroPP: Unleashing Exceptional Parallelism Efficiency through Tensor-Parallelism-Free Methodology

abstract: Large-scale models rely heavily on 3D parallelism for distributed training, which utilizes tensor parallelism (TP) as the intra-operator parallelism to partition model states across GPUs. However, TP introduces significant communication overheads and complexity in modifying single-GPU code. In this paper, we propose a TP-free distributed framework ZeroPP, which leverages the hybrid of scalable inter-operator pipeline parallelism and intra-operator fully sharded data parallelism to train models at scale, reducing memory consumption and enabling high training efficiency. Through extensive experimentation, we demonstrate that ZeroPP achieves significant performance gains of up to 33% compared to conventional 3D parallelism while maintaining comparable GPU memory consumption.


title: No-Regret Reinforcement Learning in Smooth MDPs

abstract: Obtaining no-regret guarantees for reinforcement learning (RL) in the case of problems with continuous state and/or action spaces is still one of the major open challenges in the field. Recently, a variety of solutions have been proposed, but besides very specific settings, the general problem remains unsolved. In this paper, we introduce a novel structural assumption on the Markov decision processes (MDPs), namely $\nu-$smoothness, that generalizes most of the settings proposed so far (e.g., linear MDPs and Lipschitz MDPs). To face this challenging scenario, we propose two algorithms for regret minimization in $\nu-$smooth MDPs. Both algorithms build upon the idea of constructing an MDP representation through an orthogonal feature map based on Legendre polynomials. The first algorithm, \textsc{Legendre-Eleanor}, archives the no-regret property under weaker assumptions but is computationally inefficient, whereas the second one, \textsc{Legendre-LSVI}, runs in polynomial time, although for a smaller class of problems. After analyzing their regret properties, we compare our results with state-of-the-art ones from RL theory, showing that our algorithms achieve the best guarantees.


title: Quantum Heisenberg Enveloping Algebra

abstract: In this article, the two-parameter quantum Heisenberg enveloping algebra, which serves as a model for certain quantum generalized Heisenberg algebras, have been studied at roots of unity. In this context, the quantum Heisenberg enveloping algebra becomes a polynomial identity algebra, and the dimension of simple modules is bounded by its PI degree. The PI degree, center, and complete classification of simple modules up to isomorphism are explicitly presented. We work over a field of arbitrary characteristic, although our results concerning the representations require that it is algebraically closed.


title: Simulating the epoch of Helium Reionization in photon-conserving semi-numerical code SCRIPT

abstract: The reionization of the second electron of helium (HeII) leaves important imprints on the thermal and ionization state of the intergalactic medium (IGM). Observational evidence suggests that HeII reionization ended at $z \simeq 3$ due to ionizing photons emitted predominantly by quasars. We present efficient semi-numerical simulations of helium reionization in a $230 \ \mathrm{h^{-1}~Mpc}$ box, that takes into account the spatial patchiness of reionization coupled with photoheating of the IGM. Dark matter haloes are assigned quasars using empirical measurements of the quasar luminosity function, assuming a universal quasar lifetime consistent with duty cycle values inferred from measurements of the quasar clustering. The ionizing photon field from quasars is then included in the semi-numerical Code for ReionIzation with PhoTon conservation (SCRIPT), which was originally developed for modeling hydrogen reionization. In this work, we make appropriate modifications to SCRIPT for modeling inhomogenous HeII reionization and the corresponding thermal history of the IGM is modelled via a subgrid prescription. Our model has three main free parameters i.e. the global clumping factor $\mathcal{C}_{HeIII}$, the temperature increase due to photoheating $T^{re}_{He}$ and the quasar spectral energy distribution (SED) index, $\alpha_{UV}$. Our fiducial model with $\mathcal{C}_{HeIII}=15.6$ and $T^{re}_{He} \sim 6000 \ K$ gives reasonable values for the empirical measurements of the temperature density equation of state at these redshifts, assuming that quasars brighter than $\mathrm{M_{1450}}<-21$ and having $\alpha_{UV}=1.7$ contribute to HeII reionization. The efficiency of our code shows promising prospects for performing parameter estimation in future, for models of HeII reionization using observations of the Ly$\alpha$ forest.


title: Energy-based Domain-Adaptive Segmentation with Depth Guidance

abstract: Recent endeavors have been made to leverage self-supervised depth estimation as guidance in unsupervised domain adaptation (UDA) for semantic segmentation. Prior arts, however, overlook the discrepancy between semantic and depth features, as well as the reliability of feature fusion, thus leading to suboptimal segmentation performance. To address this issue, we propose a novel UDA framework called SMART (croSs doMain semAntic segmentation based on eneRgy esTimation) that utilizes Energy-Based Models (EBMs) to obtain task-adaptive features and achieve reliable feature fusion for semantic segmentation with self-supervised depth estimates. Our framework incorporates two novel components: energy-based feature fusion (EB2F) and energy-based reliable fusion Assessment (RFA) modules. The EB2F module produces task-adaptive semantic and depth features by explicitly measuring and reducing their discrepancy using Hopfield energy for better feature fusion. The RFA module evaluates the reliability of the feature fusion using an energy score to improve the effectiveness of depth guidance. Extensive experiments on two datasets demonstrate that our method achieves significant performance gains over prior works, validating the effectiveness of our energy-based learning approach.


title: Face Detection: Present State and Research Directions

abstract: The majority of computer vision applications that handle images featuring humans use face detection as a core component. Face detection still has issues, despite much research on the topic. Face detection's accuracy and speed might yet be increased. This review paper shows the progress made in this area as well as the substantial issues that still need to be tackled. The paper provides research directions that can be taken up as research projects in the field of face detection.