title: Augmenting MRI scan data with real-time predictions of glioblastoma brain tumor evolution using exponential time integrators

abstract: We present an ultra-fast simulator to augment the MRI scan imaging of glioblastoma brain tumors with predictions of future evolution. We consider the glioblastoma tumor growth model based on the Fisher-Kolmogorov diffusion-reaction equation with logistic growth. For the discretization we employ finite differences in space coupled with a time integrator in time employing the routines from [Al-Mohy, et. al. Computing the action of the matrix exponential, with an application to exponential integrators, SIAM Journal on Scientific Computing, 2011] to compute the actions of the exponentials of the linear operator. By combining these methods, we can perform the prediction of the tumor evolution for several months forward within a couple of seconds on a modern laptop. This method does not require HPC supercomputing centers, and it can be performed on the fly using a laptop with Windows 10, Octave simulations, and ParaView visualization. We illustrate our simulations by predicting the tumor growth evolution based on three-dimensional MRI scan data.


title: InceptionCapsule: Inception-Resnet and CapsuleNet with self-attention for medical image Classification

abstract: Initial weighting is significant in deep neural networks because the random selection of weights produces different outputs and increases the probability of overfitting and underfitting. On the other hand, vector-based approaches to extract vector features need rich vectors for more accurate classification. The InceptionCapsule approach is presented to alleviate these two problems. This approach uses transfer learning and the Inception-ResNet model to avoid random selection of weights, which takes initial weights from ImageNet. It also uses the output of Inception middle layers to generate rich vectors. Extracted vectors are given to a capsule network for learning, which is equipped with an attention technique. Kvasir data and BUSI with the GT dataset were used to evaluate this approach. This model was able to achieve 97.62 accuracies in 5-class classification and also achieved 94.30 accuracies in 8-class classification on Kvasir. In the BUSI with GT dataset, the proposed approach achieved accuracy=98.88, Precision=95.34, and F1-score=93.74, which are acceptable results compared to other approaches in the literature.


title: SudokuSens: Enhancing Deep Learning Robustness for IoT Sensing Applications using a Generative Approach

abstract: This paper introduces SudokuSens, a generative framework for automated generation of training data in machine-learning-based Internet-of-Things (IoT) applications, such that the generated synthetic data mimic experimental configurations not encountered during actual sensor data collection. The framework improves the robustness of resulting deep learning models, and is intended for IoT applications where data collection is expensive. The work is motivated by the fact that IoT time-series data entangle the signatures of observed objects with the confounding intrinsic properties of the surrounding environment and the dynamic environmental disturbances experienced. To incorporate sufficient diversity into the IoT training data, one therefore needs to consider a combinatorial explosion of training cases that are multiplicative in the number of objects considered and the possible environmental conditions in which such objects may be encountered. Our framework substantially reduces these multiplicative training needs. To decouple object signatures from environmental conditions, we employ a Conditional Variational Autoencoder (CVAE) that allows us to reduce data collection needs from multiplicative to (nearly) linear, while synthetically generating (data for) the missing conditions. To obtain robustness with respect to dynamic disturbances, a session-aware temporal contrastive learning approach is taken. Integrating the aforementioned two approaches, SudokuSens significantly improves the robustness of deep learning for IoT applications. We explore the degree to which SudokuSens benefits downstream inference tasks in different data sets and discuss conditions under which the approach is particularly effective.


title: Asymptotic analysis for stationary distributions of scaled reaction networks

abstract: We study stationary distributions in the context of stochastic reaction networks. In particular, we are interested in complex balanced reaction networks and reduction of such networks by assuming a set of species (called non-interacting species) are degraded fast (and therefore essentially absent in the network), implying some reaction rates are large compared to others. Technically, we assume these reaction rates are scaled by a common parameter $N$ and let $N\to\infty$. The limiting stationary distribution as $N\to\infty$ is compared to the stationary distribution of the reduced reaction network obtained by algebraic elimination of the non-interacting species. In general, the limiting stationary distribution might differ from the stationary distribution of the reduced reaction network. We identify various sufficient conditions for when these two distributions are the same, including when the reaction network is detailed balanced and when the set of non-interacting species consists of intermediate species. In the latter case, the limiting stationary distribution essentially retains the form of the complex balanced distribution. This finding is particularly surprising given that the reduced reaction network might be non-weakly reversible and exhibit unconventional kinetics.


title: Causal Bayesian Optimization via Exogenous Distribution Learning

abstract: Maximizing a target variable as an operational objective in a structural causal model is an important problem. Existing Causal Bayesian Optimization~(CBO) methods either rely on hard interventions that alter the causal structure to maximize the reward; or introduce action nodes to endogenous variables so that the data generation mechanisms are adjusted to achieve the objective. In this paper, a novel method is introduced to learn the distribution of exogenous variables, which is typically ignored or marginalized through expectation by existing methods. Exogenous distribution learning improves the approximation accuracy of structural causal models in a surrogate model that is usually trained with limited observational data. Moreover, the learned exogenous distribution extends existing CBO to general causal schemes beyond Additive Noise Models~(ANM). The recovery of exogenous variables allows us to use a more flexible prior for noise or unobserved hidden variables. We develop a new CBO method by leveraging the learned exogenous distribution. Experiments on different datasets and applications show the benefits of our proposed method.


title: Borel and parabolic-type subalgebras of the lattice vertex operator algebra

abstract: In this paper, we introduce and study some new classes of subalgebras of the lattice vertex operator algebras, which we call the Borel-type and parabolic-type subVOAs. For the lowest-rank examples of Borel-type subVOAs $V_{B}$ of $V_{\Z\al}$, and one nontrivial lowest-rank example of the parabolic-type subVOA $V_P$ of the lattice VOA $V_{A_2}$ associated to the root lattice $A_2$, we explicitly determine their Zhu's algebras $A(V_B)$ and $A(V_P)$ in terms of generators and relations. Using the descriptions of $A(V_B)$ and $A(V_P)$, we classify the irreducible modules over $V_B$ and $V_P$.


title: Bosehedral: Compiler Optimization for Bosonic Quantum Computing

abstract: Bosonic quantum computing, based on the infinite-dimensional qumodes, has shown promise for various practical applications that are classically hard. However, the lack of compiler optimizations has hindered its full potential. This paper introduces Bosehedral, an efficient compiler optimization framework for (Gaussian) Boson sampling on Bosonic quantum hardware. Bosehedral overcomes the challenge of handling infinite-dimensional qumode gate matrices by performing all its program analysis and optimizations at a higher algorithmic level, using a compact unitary matrix representation. It optimizes qumode gate decomposition and logical-to-physical qumode mapping, and introduces a tunable probabilistic gate dropout method. Overall, Bosehedral significantly improves the performance by accurately approximating the original program with much fewer gates. Our evaluation shows that Bosehedral can largely reduce the program size but still maintain a high approximation fidelity, which can translate to significant end-to-end application performance improvement.


title: Spline-Based Stochastic Collocation Methods for Uncertainty Quantification in Nonlinear Hyperbolic PDEs

abstract: In this paper, we study the stochastic collocation (SC) methods for uncertainty quantification (UQ) in hyperbolic systems of nonlinear partial differential equations (PDEs). In these methods, the underlying PDEs are numerically solved at a set of collocation points in random space. A standard SC approach is based on a generalized polynomial chaos (gPC) expansion, which relies on choosing the collocation points based on the prescribed probability distribution and approximating the computed solution by a linear combination of orthogonal polynomials in the random variable. We demonstrate that this approach struggles to accurately capture discontinuous solutions, often leading to oscillations (Gibbs phenomenon) that deviate significantly from the physical solutions. We explore alternative SC methods, in which one can choose an arbitrary set of collocation points and employ shape-preserving splines to interpolate the solution in a random space. Our study demonstrates the effectiveness of spline-based collocation in accurately capturing and assessing uncertainties while suppressing oscillations. We illustrate the superiority of the spline-based collocation on two numerical examples, including the inviscid Burgers and shallow water equations.


title: On a Quasilinear Parabolic-Hyperbolic System Arising in MEMS Modeling

abstract: A coupled system consisting of a quasilinear parabolic equation and a semilinear hyperbolic equation is considered. The problem arises as a small aspect ratio limit in the modeling of a MEMS device taking into account the gap width of the device and the gas pressure. The system is regarded as a special case of a more general setting for which local well-posedness of strong solutions is shown. The general result applies to different cases including a coupling of the parabolic equation to a semilinear wave equation of either second or fourth order, the latter featuring either clamped or pinned boundary conditions.


title: Difference operators on lattices

abstract: A differential operator of weight $\lambda$ is the algebraic abstraction of the difference quotient $d_\lambda(f)(x):=\big(f(x+\lambda)-f(x)\big)/\lambda$, including both the derivation as $\lambda$ approaches to $0$ and the difference operator when $\lambda=1$. Correspondingly, differential algebra of weight $\lambda$ extends the well-established theories of differential algebra and difference algebra. In this paper, we initiate the study of differential operators with weights, in particular difference operators, on lattices. We show that differential operators of weight $-1$ on a lattice coincide with differential operators, while differential operators are special cases of difference operators. Distributivity of a lattice is characterized by the existence of certain difference operators. Furthermore, we characterize and enumerate difference operators on finite chains and finite quasi-antichains.


title: Radio properties of high-redshift galaxies at $z \geq 1$

abstract: Study of high-redshift radio galaxies (HzRGs) can shed light on the active galactic nuclei (AGNs) evolution in massive elliptical galaxies. The vast majority of observed high-redshift AGNs are quasars, and there are very few radio galaxies at redshifts $z>3$. We present the radio properties of 173 sources optically identified with radio galaxies at $z\geqslant1$ with flux densities $S_{1.4}\geqslant20$ mJy. Literature data were collected for compilation of broadband radio spectra, estimation of radio variability, radio luminosity, and radio loudness. Almost 60% of the galaxies have steep or ultra-steep radio spectra; 22% have flat, inverted, upturn, and complex spectral shapes, and 18% have peaked spectra (PS). The majority of the PS sources in the sample (20/31) are megahertz-peaked spectrum sources candidates, i.e. possibly very young and compact radio galaxies. The median values of the variability indices at 11 and 5 GHz are $V_{S_{11}}=0.14$ and $V_{S_{5}}=0.13$, which generally indicates a weak or moderate character of the long-term variability of the studied galaxies. The typical radio luminosity and radio loudness are $L_{5}=10^{43}$ - $10^{44}$ erg*s$^{-1}$ and $\log R=3$ - $4$ respectively. We have found less prominent features of the bright compact radio cores for our sample compared to high-redshift quasars at $z\geq3$. The variety of the obtained radio properties shows the different conditions for the formation of radio emission sources in galaxies.


title: Variable-order fractional Laplacian and its accurate and efficient computations with meshfree methods

abstract: The variable-order fractional Laplacian plays an important role in the study of heterogeneous systems. In this paper, we propose the first numerical methods for the variable-order Laplacian $(-\Delta)^{\alpha({\bf x})/2}$ with $0 < \alpha({\bf x}) \le 2$, which will also be referred as the variable-order fractional Laplacian if $\alpha({\bf x})$ is strictly less than 2. We present a class of hypergeometric functions whose variable-order Laplacian can be analytically expressed. Building on these analytical results, we design the meshfree methods based on globally supported radial basis functions (RBFs), including Gaussian, generalized inverse multiquadric, and Bessel-type RBFs, to approximate the variable-order Laplacian $(-\Delta)^{\alpha({\bf x})/2}$. Our meshfree methods integrate the advantages of both pseudo-differential and hypersingular integral forms of the variable-order fractional Laplacian, and thus avoid numerically approximating the hypersingular integral. Moreover, our methods are simple and flexible of domain geometry, and their computer implementation remains the same for any dimension $d \ge 1$. Compared to finite difference methods, our methods can achieve a desired accuracy with much fewer points. This fact makes our method much attractive for problems involving variable-order fractional Laplacian where the number of points required is a critical cost. We then apply our method to study solution behaviors of variable-order fractional PDEs arising in different fields, including transition of waves between classical and fractional media, and coexistence of anomalous and normal diffusion in both diffusion equation and the Allen-Cahn equation. These results would provide insights for further understanding and applications of variable-order fractional derivatives.


title: SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking

abstract: In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to the prompt, requiring access to labeled training data. Procuring such training data for a wide range of domains and applications is time-consuming, expensive, and, at times, infeasible. While zero-shot learning requires no training data, it significantly lags behind the few-shot setup. Thus, `\textit{Can we efficiently generate synthetic data for any dialogue schema to enable few-shot prompting?}' Addressing this question, we propose \method, a data generation framework tailored for DST, utilizing LLMs. Our approach only requires the dialogue schema and a few hand-crafted dialogue templates to synthesize natural, coherent, and free-flowing dialogues with DST annotations. Few-shot learning using data from {\method} results in $4-5%$ improvement in Joint Goal Accuracy over the zero-shot baseline on MultiWOZ 2.1 and 2.4. Remarkably, our few-shot learning approach recovers nearly $98%$ of the performance compared to the few-shot setup using human-annotated training data. Our synthetic data and code can be accessed at https://github.com/apple/ml-synthdst


title: Multi-Level Aggregation and Recursive Alignment Architecture for Efficient Parallel Inference Segmentation Network

abstract: Real-time semantic segmentation is a crucial research for real-world applications. However, many methods lay particular emphasis on reducing the computational complexity and model size, while largely sacrificing the accuracy. To tackle this problem, we propose a parallel inference network customized for semantic segmentation tasks to achieve a good trade-off between speed and accuracy. We employ a shallow backbone to ensure real-time speed, and propose three core components to compensate for the reduced model capacity to improve accuracy. Specifically, we first design a dual-pyramidal path architecture (Multi-level Feature Aggregation Module, MFAM) to aggregate multi-level features from the encoder to each scale, providing hierarchical clues for subsequent spatial alignment and corresponding in-network inference. Then, we build Recursive Alignment Module (RAM) by combining the flow-based alignment module with recursive upsampling architecture for accurate spatial alignment between multi-scale feature maps with half the computational complexity of the straightforward alignment method. Finally, we perform independent parallel inference on the aligned features to obtain multi-scale scores, and adaptively fuse them through an attention-based Adaptive Scores Fusion Module (ASFM) so that the final prediction can favor objects of multiple scales. Our framework shows a better balance between speed and accuracy than state-of-the-art real-time methods on Cityscapes and CamVid datasets. We also conducted systematic ablation studies to gain insight into our motivation and architectural design. Code is available at: https://github.com/Yanhua-Zhang/MFARANet.


title: Future Directions in the Theory of Graph Machine Learning

abstract: Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite their practical success, our theoretical understanding of the properties of GNNs remains highly incomplete. Recent theoretical advancements primarily focus on elucidating the coarse-grained expressive power of GNNs, predominantly employing combinatorial techniques. However, these studies do not perfectly align with practice, particularly in understanding the generalization behavior of GNNs when trained with stochastic first-order optimization techniques. In this position paper, we argue that the graph machine learning community needs to shift its attention to developing a balanced theory of graph machine learning, focusing on a more thorough understanding of the interplay of expressive power, generalization, and optimization.


title: $\textit{A Contrario}$ Paradigm for YOLO-based Infrared Small Target Detection

abstract: Detecting small to tiny targets in infrared images is a challenging task in computer vision, especially when it comes to differentiating these targets from noisy or textured backgrounds. Traditional object detection methods such as YOLO struggle to detect tiny objects compared to segmentation neural networks, resulting in weaker performance when detecting small targets. To reduce the number of false alarms while maintaining a high detection rate, we introduce an $\textit{a contrario}$ decision criterion into the training of a YOLO detector. The latter takes advantage of the $\textit{unexpectedness}$ of small targets to discriminate them from complex backgrounds. Adding this statistical criterion to a YOLOv7-tiny bridges the performance gap between state-of-the-art segmentation methods for infrared small target detection and object detection networks. It also significantly increases the robustness of YOLO towards few-shot settings.


title: SemPool: Simple, robust, and interpretable KG pooling for enhancing language models

abstract: Knowledge Graph (KG) powered question answering (QA) performs complex reasoning over language semantics as well as knowledge facts. Graph Neural Networks (GNNs) learn to aggregate information from the underlying KG, which is combined with Language Models (LMs) for effective reasoning with the given question. However, GNN-based methods for QA rely on the graph information of the candidate answer nodes, which limits their effectiveness in more challenging settings where critical answer information is not included in the KG. We propose a simple graph pooling approach that learns useful semantics of the KG that can aid the LM's reasoning and that its effectiveness is robust under graph perturbations. Our method, termed SemPool, represents KG facts with pre-trained LMs, learns to aggregate their semantic information, and fuses it at different layers of the LM. Our experimental results show that SemPool outperforms state-of-the-art GNN-based methods by 2.27% accuracy points on average when answer information is missing from the KG. In addition, SemPool offers interpretability on what type of graph information is fused at different LM layers.


title: Goodness-of-Fit and Clustering of Spherical Data: the QuadratiK package in R and Python

abstract: We introduce the QuadratiK package that incorporates innovative data analysis methodologies. The presented software, implemented in both R and Python, offers a comprehensive set of goodness-of-fit tests and clustering techniques using kernel-based quadratic distances, thereby bridging the gap between the statistical and machine learning literatures. Our software implements one, two and k-sample tests for goodness of fit, providing an efficient and mathematically sound way to assess the fit of probability distributions. Expanded capabilities of our software include supporting tests for uniformity on the $d$-dimensional Sphere based on Poisson kernel densities, and algorithms for generating random samples from Poisson kernel densities. Particularly noteworthy is the incorporation of a unique clustering algorithm specifically tailored for spherical data that leverages a mixture of Poisson-kernel-based densities on the sphere. Alongside this, our software includes additional graphical functions, aiding the users in validating, as well as visualizing and representing clustering results. This enhances interpretability and usability of the analysis. In summary, our R and Python packages serve as a powerful suite of tools, offering researchers and practitioners the means to delve deeper into their data, draw robust inference, and conduct potentially impactful analyses and inference across a wide array of disciplines.


title: Construction of continuous K-g-Frames in Hilbert $C^{\ast}$-Modules

abstract: In this work, we provide some constructions and the sum of new continuous K-g-frames in Hilbert$C^{\ast}$-Modules. We provide certain necessary and sufficient conditions for some adjointable operators on $\mathcal{H}$, under which new continuous K-g-frames can be retrieved from those that already exist. Additionally, we discuss the sum of continuous K-g-frames, discover some of their characterizations, and offer some adjointable operators to construct new continuous K-g-frames from the previous ones.


title: A 3-D Full-Wave Model to Study the Impact of Soybean Components and Structure on L-Band Backscatter

abstract: Microwave remote sensing offers a powerful tool for monitoring the growth of short, dense vegetation like soybean. As the plants mature, changes in their biomass and 3-D structure impact the electromagnetic (EM) backscatter signal. This backscatter information holds valuable insights into crop health and yield, prompting the need for a comprehensive understanding of how structural and biophysical properties of soybeans as well as soil characteristics contribute to the overall backscatter signature. In this study, a full-wave model is developed for simulating L-band backscatter from soybean fields. Leveraging the ANSYS High-Frequency Structure Simulator (HFSS) framework, the model solves for the scattering of EM waves from realistic 3-D structural models of soybean, explicitly incorporating the interplant scattering effects. The model estimates of backscatter match well with the field observations from the SMAPVEX16-MicroWEX and SMAPVEX12, with average differences of 1-2 dB for co-pol and less than 4 dB for cross-pol. Furthermore, the model effectively replicates the temporal dynamics of crop backscatter throughout the growing season. The HFSS analysis revealed that the stems and pods are the primary contributors to HH-pol backscatter, while the branches contribute to VV-pol, and leaves impact the cross-pol signatures. In addition, a sensitivity study with 3-D bare soil surface resulted in an average variation of 8 dB in co- and cross-pol, even when the root mean square height and correlation length were held constant.


title: Refractive index measurements in absorbing media with white light spectral interferometry

abstract: White light spectral interferometry is applied to measure the refractive index in absorbing liquids in the spectral range from 400 to 1000 nm. We analyze the influence of absorption on the visibility of interferometric fringes and, accordingly, on the measurement of the refractive index. Further, we show that the refractive index in the absorption band can be retrieved by a two step process. The procedure requires the use of two samples of different thickness, the thicker one to retrieve the refractive index in the transparent region and the thinnest to obtain the data in the absorption region. First, the refractive index values are retrieved with good accuracy in the transparent region of the material for 1 mm thick samples. Second, these refractive index values serve also to precisely calculate the thickness of a thinner sample (about 150 micrometers) since the accuracy of the method depends strongly on the thickness of the sample. Finally, the refractive index is recovered for the entire spectral range. Copyright 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement. See corresponding link in the pdf file.


title: Dirac operators and field equations of the gravitational field and matter fields

abstract: Dirac operators on curved space-times are introduced with the help of a new point-view that observers have to be included in the formulation of natural laws. The class of Dirac operators are Lorentz invariant in the sense that the transformation rule is specified under diffeomorphisms of the space-time which preserve the time orientation and the gravitational field. Moreover these Dirac operators, like the original Dirac's operator with the special relativity, satisfy the Hamiltonian relation required by the general theory of relativity up to a correction due to the setup of a reference frame. In order to generalise (or discover) Dirac operators, which have been an important building block in the quantum field theories (QFTs), to curved space-times, we bring observers (which are elements of the principal orthonormal bundle over the space-time with its structure group being the proper Lorentz group) into the description of Fermion fields in the presence of a gravitational field. As a consequence field equations combining the gravitational field and matter fields may be formulated. This work suggests that observational effects (due to the setup of references) in the presence of a strong gravitational field, i.e. matter, may be unavoidable.


title: WENO reconstructions of unconditionally optimal high order

abstract: A modified Weighted Essentially Non-Oscillatory (WENO) reconstruction technique preventing accuracy loss near critical points (regardless of their order) of the underlying data is presented. This approach only uses local data from the reconstruction stencil and does not rely on any sort of scaling parameters. The key novel ingredient is a weight design based on a new smoothness indicator, which defines the first WENO reconstruction procedure that never loses accuracy on smooth data, regardless of the presence of critical points of any order, and is therefore addressed as optimal WENO (OWENO) method. The corresponding weights are non-dimensional and scale-independent. The weight designs are supported by theoretical results concerning the accuracy of the smoothness indicators. The method is validated by numerical tests related to algebraic equations, scalar conservation laws, and systems of conservation laws.


title: Preconditionals

abstract: In recent work, we introduced a new semantics for conditionals, covering a large class of what we call preconditionals. In this paper, we undertake an axiomatic study of preconditionals and subclasses of preconditionals. We then prove that any bounded lattice equipped with a preconditional can be represented by a relational structure, suitably topologized, yielding a single relational semantics for conditional logics normally treated by different semantics, as well as generalizing beyond those semantics.


title: Denoising Diffusion-Based Control of Nonlinear Systems

abstract: We propose a novel approach based on Denoising Diffusion Probabilistic Models (DDPMs) to control nonlinear dynamical systems. DDPMs are the state-of-art of generative models that have achieved success in a wide variety of sampling tasks. In our framework, we pose the feedback control problem as a generative task of drawing samples from a target set under control system constraints. The forward process of DDPMs constructs trajectories originating from a target set by adding noise. We learn to control a dynamical system in reverse such that the terminal state belongs to the target set. For control-affine systems without drift, we prove that the control system can exactly track the trajectory of the forward process in reverse, whenever the the Lie bracket based condition for controllability holds. We numerically study our approach on various nonlinear systems and verify our theoretical results. We also conduct numerical experiments for cases beyond our theoretical results on a physics-engine.


title: Polyp-DAM: Polyp segmentation via depth anything model

abstract: Recently, large models (Segment Anything model) came on the scene to provide a new baseline for polyp segmentation tasks. This demonstrates that large models with a sufficient image level prior can achieve promising performance on a given task. In this paper, we unfold a new perspective on polyp segmentation modeling by leveraging the Depth Anything Model (DAM) to provide depth prior to polyp segmentation models. Specifically, the input polyp image is first passed through a frozen DAM to generate a depth map. The depth map and the input polyp images are then concatenated and fed into a convolutional neural network with multiscale to generate segmented images. Extensive experimental results demonstrate the effectiveness of our method, and in addition, we observe that our method still performs well on images of polyps with noise. The URL of our code is \url{https://github.com/zzr-idam/Polyp-DAM}.


title: A Review and Comparison of AI Enhanced Side Channel Analysis

abstract: Side Channel Analysis (SCA) presents a clear threat to privacy and security in modern computing systems. The vast majority of communications are secured through cryptographic algorithms. These algorithms are often provably-secure from a cryptographical perspective, but their implementation on real hardware introduces vulnerabilities. Adversaries can exploit these vulnerabilities to conduct SCA and recover confidential information, such as secret keys or internal states. The threat of SCA has greatly increased as machine learning, and in particular deep learning, enhanced attacks become more common. In this work, we will examine the latest state-of-the-art deep learning techniques for side channel analysis, the theory behind them, and how they are conducted. Our focus will be on profiling attacks using deep learning techniques, but we will also examine some new and emerging methodologies enhanced by deep learning techniques, such as non-profiled attacks, artificial trace generation, and others. Finally, different deep learning enhanced SCA schemes attempted against the ANSSI SCA Database (ASCAD) and their relative performance will be evaluated and compared. This will lead to new research directions to secure cryptographic implementations against the latest SCA attacks.


title: An efficient third-order WENO scheme with unconditionally optimal accuracy

abstract: A novel scheme, based on third-order Weighted Essentially Non-Oscillatory (WENO) reconstructions, is presented. It attains unconditionally optimal accuracy when the data is smooth enough, even in presence of critical points, and second-order accuracy if a discontinuity crosses the data. The key to attribute these properties to this scheme is the inclusion of an additional node in the data stencil, which is only used in the computation of the weights measuring the smoothness. The accuracy properties of this scheme are proven in detail and several numerical experiments are presented, which show that this scheme is more efficient in terms of the error reduction versus CPU time than its traditional third-order counterparts as well as several higher-order WENO schemes that are found in the literature.


title: MATLAB Simulator of Level-Index Arithmetic

abstract: Level-index arithmetic appeared in the 1980s. One of its principal purposes is to abolish the issues caused by underflows and overflows in floating point. However, level-index arithmetic does not expand the set of numbers but spaces out the numbers of large magnitude even more than floating-point representations to move the infinities further away from zero: gaps between numbers on both ends of the range become very large. We revisit level index by presenting a custom precision simulator in MATLAB. This toolbox is useful for exploring performance of level-index arithmetic in research projects, such as using 8-bit and 16-bit representations in machine learning algorithms where narrow bit-width is desired but overflow/underflow of floating-point representations causes difficulties.


title: Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokens

abstract: While massively multilingual speech models like wav2vec 2.0 XLSR-128 can be directly fine-tuned for automatic speech recognition (ASR), downstream performance can still be relatively poor on languages that are under-represented in the pre-training data. Continued pre-training on 70-200 hours of untranscribed speech in these languages can help -- but what about languages without that much recorded data? For such cases, we show that supplementing the target language with data from a similar, higher-resource 'donor' language can help. For example, continued pre-training on only 10 hours of low-resource Punjabi supplemented with 60 hours of donor Hindi is almost as good as continued pretraining on 70 hours of Punjabi. By contrast, sourcing data from less similar donors like Bengali does not improve ASR performance. To inform donor language selection, we propose a novel similarity metric based on the sequence distribution of induced acoustic units: the Acoustic Token Distribution Similarity (ATDS). Across a set of typologically different target languages (Punjabi, Galician, Iban, Setswana), we show that the ATDS between the target language and its candidate donors precisely predicts target language ASR performance.


title: Bootstrapping Fisher Market Equilibrium and First-Price Pacing Equilibrium

abstract: The linear Fisher market (LFM) is a basic equilibrium model from economics, which also has applications in fair and efficient resource allocation. First-price pacing equilibrium (FPPE) is a model capturing budget-management mechanisms in first-price auctions. In certain practical settings such as advertising auctions, there is an interest in performing statistical inference over these models. A popular methodology for general statistical inference is the bootstrap procedure. Yet, for LFM and FPPE there is no existing theory for the valid application of bootstrap procedures. In this paper, we introduce and devise several statistically valid bootstrap inference procedures for LFM and FPPE. The most challenging part is to bootstrap general FPPE, which reduces to bootstrapping constrained M-estimators, a largely unexplored problem. We devise a bootstrap procedure for FPPE under mild degeneracy conditions by using the powerful tool of epi-convergence theory. Experiments with synthetic and semi-real data verify our theory.


title: Efficient Numerical Wave Propagation Enhanced By An End-to-End Deep Learning Model

abstract: Recent advances in wave modeling use sufficiently accurate fine solver outputs to train a neural network that enhances the accuracy of a fast but inaccurate coarse solver. In this paper we build upon the work of Nguyen and Tsai (2023) and present a novel unified system that integrates a numerical solver with a deep learning component into an end-to-end framework. In the proposed setting, we investigate refinements to the network architecture and data generation algorithm. A stable and fast solver further allows the use of Parareal, a parallel-in-time algorithm to correct high-frequency wave components. Our results show that the cohesive structure improves performance without sacrificing speed, and demonstrate the importance of temporal dynamics, as well as Parareal, for accurate wave propagation.


title: On the Castelnuovo-Mumford regularity of subspace arrangements

abstract: Let $X$ be the union of $n$ generic linear subspaces of codimension $>1$ in $\mathbb{P}^d$. Improving an earlier bound due to Derksen and Sidman, we prove that the Castelnuovo-Mumford regularity of $X$ satisfies $ \operatorname{reg}(X) \le n - [n / (2d-1)]$.


title: A flexible Bayesian g-formula for causal survival analyses with time-dependent confounding

abstract: In longitudinal observational studies with a time-to-event outcome, a common objective in causal analysis is to estimate the causal survival curve under hypothetical intervention scenarios within the study cohort. The g-formula is a particularly useful tool for this analysis. To enhance the traditional parametric g-formula approach, we developed a more adaptable Bayesian g-formula estimator. This estimator facilitates both longitudinal predictive and causal inference. It incorporates Bayesian additive regression trees in the modeling of the time-evolving generative components, aiming to mitigate bias due to model misspecification. Specifically, we introduce a more general class of g-formulas for discrete survival data. These formulas can incorporate the longitudinal balancing scores, which serve as an effective method for dimension reduction and are vital when dealing with an expanding array of time-varying confounders. The minimum sufficient formulation of these longitudinal balancing scores is linked to the nature of treatment regimes, whether static or dynamic. For each type of treatment regime, we provide posterior sampling algorithms, which are grounded in the Bayesian additive regression trees framework. We have conducted simulation studies to illustrate the empirical performance of our proposed Bayesian g-formula estimators, and to compare them with existing parametric estimators. We further demonstrate the practical utility of our methods in real-world scenarios using data from the Yale New Haven Health System's electronic health records.


title: Joint Activity and Data Detection for Massive Grant-Free Access Using Deterministic Non-Orthogonal Signatures

abstract: Grant-free access is a key enabler for connecting wireless devices with low latency and low signaling overhead in massive machine-type communications (mMTC). For massive grant-free access, user-specific signatures are uniquely assigned to mMTC devices. In this paper, we first derive a sufficient condition for the successful identification of active devices through maximum likelihood (ML) estimation in massive grant-free access. The condition is represented by the coherence of a signature sequence matrix containing the signatures of all devices. Then, we present a design framework of non-orthogonal signature sequences in a deterministic fashion. The design principle relies on unimodular masking sequences with low correlation, which are applied as masking sequences to the columns of the discrete Fourier transform (DFT) matrix. For example constructions, we use four polyphase masking sequences represented by characters over finite fields. Leveraging algebraic techniques, we show that the signature sequence matrix of proposed non-orthogonal sequences has theoretically bounded low coherence. Simulation results demonstrate that the deterministic non-orthogonal signatures achieve the excellent performance of joint activity and data detection by ML- and approximate message passing (AMP)-based algorithms for massive grant-free access in mMTC.


title: Language-guided Active Sensing of Confined, Cluttered Environments via Object Rearrangement Planning

abstract: Language-guided active sensing is a robotics subtask where a robot with an onboard sensor interacts efficiently with the environment via object manipulation to maximize perceptual information, following given language instructions. These tasks appear in various practical robotics applications, such as household service, search and rescue, and environment monitoring. Despite many applications, the existing works do not account for language instructions and have mainly focused on surface sensing, i.e., perceiving the environment from the outside without rearranging it for dense sensing. Therefore, in this paper, we introduce the first language-guided active sensing approach that allows users to observe specific parts of the environment via object manipulation. Our method spatially associates the environment with language instructions, determines the best camera viewpoints for perception, and then iteratively selects and relocates the best view-blocking objects to provide the dense perception of the region of interest. We evaluate our method against different baseline algorithms in simulation and also demonstrate it in real-world confined cabinet-like settings with multiple unknown objects. Our results show that the proposed method exhibits better performance across different metrics and successfully generalizes to real-world complex scenarios.


title: Jailbreaking Attack against Multimodal Large Language Model

abstract: This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is proposed to find an \emph{image Jailbreaking Prompt} (imgJP), enabling jailbreaks against MLLMs across multiple unseen prompts and images (i.e., data-universal property). Our approach exhibits strong model-transferability, as the generated imgJP can be transferred to jailbreak various models, including MiniGPT-v2, LLaVA, InstructBLIP, and mPLUG-Owl2, in a black-box manner. Moreover, we reveal a connection between MLLM-jailbreaks and LLM-jailbreaks. As a result, we introduce a construction-based method to harness our approach for LLM-jailbreaks, demonstrating greater efficiency than current state-of-the-art methods. The code is available here. \textbf{Warning: some content generated by language models may be offensive to some readers.}


title: Topological effect on the Anderson transition in chiral symmetry classes

abstract: The interplay between disorder and weak topology in chiral symmetry classes leads to an intermediate phase between metal and localized phases, dubbed quasi-localized phase, where wave function along a spatial direction with weak topological index is delocalized but exponentially localized along the other directions. In this Letter, we propose a mechanism of the emergent quasi-localized phase in chiral symmetry classes. The Anderson transition in 2D chiral symmetry classes is induced by proliferation of vortex-antivortex pairs of a U(1) phase degree of freedom, while the weak topology endows the pair with Berry phase. We argue that the Berry phase induces spatial polarizations of the pairs along the topological direction through quantum interference effect, and the proliferation of the polarized vortex pairs results in the quasi-localized phase.


title: A free-space coupled, large-active-area superconducting microstrip single-photon detector for photon-counting time-of-flight imaging

abstract: Numerous applications at the photon-starved regime require a free-space coupling singlephoton detector with a large active area, low dark count rate (DCR), and superior time resolutions. Here,we developed a superconducting microstrip single-photon detector (SMSPD), with a large active area of 260 um in diameter, a DCR of ~5 kcps, and a low time jitter of ~171 ps, operated at near-infrared of 1550 nm. As a demonstration, we applied the detector to a single-pixel galvanometer scanning system and successfully reconstructed object information in depth and intensity using a time-correlated photon counting technology.


title: Higher Congruences in Character Tables

abstract: Motivated by recent work of Peluse and Soundararajan on divisibility properties of the entries of the character tables of symmetric groups, we investigate the question: For a finite group G, when are two columns of the character table of G congruent to one another modulo a power of a prime?


title: CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization

abstract: This paper introduces a new approach based on a coupled representation and a neural volume optimization to implicitly perform 3D shape editing in latent space. This work has three innovations. First, we design the coupled neural shape (CNS) representation for supporting 3D shape editing. This representation includes a latent code, which captures high-level global semantics of the shape, and a 3D neural feature volume, which provides a spatial context to associate with the local shape changes given by the editing. Second, we formulate the coupled neural shape optimization procedure to co-optimize the two coupled components in the representation subject to the editing operation. Last, we offer various 3D shape editing operators, i.e., copy, resize, delete, and drag, and derive each into an objective for guiding the CNS optimization, such that we can iteratively co-optimize the latent code and neural feature volume to match the editing target. With our approach, we can achieve a rich variety of editing results that are not only aware of the shape semantics but are also not easy to achieve by existing approaches. Both quantitative and qualitative evaluations demonstrate the strong capabilities of our approach over the state-of-the-art solutions.


title: Selecting Large Language Model to Fine-tune via Rectified Scaling Law

abstract: The ever-growing ecosystem of LLMs has posed a challenge in selecting the most appropriate pre-trained model to fine-tune amidst a sea of options. Given constrained resources, fine-tuning all models and making selections afterward is unrealistic. In this work, we formulate this resource-constrained selection task into predicting fine-tuning performance and illustrate its natural connection with Scaling Law. Unlike pre-training, we find that the fine-tuning scaling curve includes not just the well-known "power phase" but also the previously unobserved "pre-power phase". We also explain why existing Scaling Law fails to capture this phase transition phenomenon both theoretically and empirically. To address this, we introduce the concept of "pre-learned data size" into our Rectified Scaling Law, which overcomes theoretical limitations and fits experimental results much better. By leveraging our law, we propose a novel LLM selection algorithm that selects the near-optimal model with hundreds of times less resource consumption, while other methods may provide negatively correlated selection. The project page is available at rectified-scaling-law.github.io.


title: A Survey of Large Language Models in Finance (FinLLMs)

abstract: Large Language Models (LLMs) have shown remarkable capabilities across a wide variety of Natural Language Processing (NLP) tasks and have attracted attention from multiple domains, including financial services. Despite the extensive research into general-domain LLMs, and their immense potential in finance, Financial LLM (FinLLM) research remains limited. This survey provides a comprehensive overview of FinLLMs, including their history, techniques, performance, and opportunities and challenges. Firstly, we present a chronological overview of general-domain Pre-trained Language Models (PLMs) through to current FinLLMs, including the GPT-series, selected open-source LLMs, and financial LMs. Secondly, we compare five techniques used across financial PLMs and FinLLMs, including training methods, training data, and fine-tuning methods. Thirdly, we summarize the performance evaluations of six benchmark tasks and datasets. In addition, we provide eight advanced financial NLP tasks and datasets for developing more sophisticated FinLLMs. Finally, we discuss the opportunities and the challenges facing FinLLMs, such as hallucination, privacy, and efficiency. To support AI research in finance, we compile a collection of accessible datasets and evaluation benchmarks on GitHub.


title: Your Diffusion Model is Secretly a Certifiably Robust Classifier

abstract: Diffusion models are recently employed as generative classifiers for robust classification. However, a comprehensive theoretical understanding of the robustness of diffusion classifiers is still lacking, leading us to question whether they will be vulnerable to future stronger attacks. In this study, we propose a new family of diffusion classifiers, named Noised Diffusion Classifiers~(NDCs), that possess state-of-the-art certified robustness. Specifically, we generalize the diffusion classifiers to classify Gaussian-corrupted data by deriving the evidence lower bounds (ELBOs) for these distributions, approximating the likelihood using the ELBO, and calculating classification probabilities via Bayes' theorem. We integrate these generalized diffusion classifiers with randomized smoothing to construct smoothed classifiers possessing non-constant Lipschitzness. Experimental results demonstrate the superior certified robustness of our proposed NDCs. Notably, we are the first to achieve 80\%+ and 70\%+ certified robustness on CIFAR-10 under adversarial perturbations with $\ell_2$ norm less than 0.25 and 0.5, respectively, using a single off-the-shelf diffusion model without any additional data.


title: INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformer

abstract: Recently, deep reinforcement learning has shown promising results for learning fast heuristics to solve routing problems. Meanwhile, most of the solvers suffer from generalizing to an unseen distribution or distributions with different scales. To address this issue, we propose a novel architecture, called Invariant Nested View Transformer (INViT), which is designed to enforce a nested design together with invariant views inside the encoders to promote the generalizability of the learned solver. It applies a modified policy gradient algorithm enhanced with data augmentations. We demonstrate that the proposed INViT achieves a dominant generalization performance on both TSP and CVRP problems with various distributions and different problem scales.


title: Diversity Measurement and Subset Selection for Instruction Tuning Datasets

abstract: We aim to select data subsets for the fine-tuning of large language models to more effectively follow instructions. Prior work has emphasized the importance of diversity in dataset curation but relied on heuristics such as the number of tasks. In this paper, we use determinantal point processes to capture the diversity and quality of instruction tuning datasets for subset selection. We propose to measure dataset diversity with log determinant distance that is the distance between the dataset of interest and a maximally diverse reference dataset. Our experiments demonstrate that the proposed diversity measure in the normalized weight gradient space is correlated with downstream instruction-following performance. Consequently, it can be used to inform when data selection is the most helpful and to analyze dataset curation strategies. We demonstrate the utility of our approach on various instruction tuning datasets.


title: Smart Textile-Driven Soft Spine Exosuit for Lifting Tasks in Industrial Applications

abstract: Work related musculoskeletal disorders (WMSDs) are often caused by repetitive lifting, making them a significant concern in occupational health. Although wearable assist devices have become the norm for mitigating the risk of back pain, most spinal assist devices still possess a partially rigid structure that impacts the user comfort and flexibility. This paper addresses this issue by presenting a smart textile actuated spine assistance robotic exosuit (SARE), which can conform to the back seamlessly without impeding the user movement and is incredibly lightweight. The SARE can assist the human erector spinae to complete any action with virtually infinite degrees of freedom. To detect the strain on the spine and to control the smart textile automatically, a soft knitting sensor which utilizes fluid pressure as sensing element is used. The new device is validated experimentally with human subjects where it reduces peak electromyography (EMG) signals of lumbar erector spinae by around 32 percent in loaded and around 22 percent in unloaded conditions. Moreover, the integrated EMG decreased by around 24.2 percent under loaded condition and around 23.6 percent under unloaded condition. In summary, the artificial muscle wearable device represents an anatomical solution to reduce the risk of muscle strain, metabolic energy cost and back pain associated with repetitive lifting tasks.


title: Spin: An Efficient Secure Computation Framework with GPU Acceleration

abstract: Accuracy and efficiency remain challenges for multi-party computation (MPC) frameworks. Spin is a GPU-accelerated MPC framework that supports multiple computation parties and a dishonest majority adversarial setup. We propose optimized protocols for non-linear functions that are critical for machine learning, as well as several novel optimizations specific to attention that is the fundamental unit of Transformer models, allowing Spin to perform non-trivial CNNs training and Transformer inference without sacrificing security. At the backend level, Spin leverages GPU, CPU, and RDMA-enabled smart network cards for acceleration. Comprehensive evaluations demonstrate that Spin can be up to $2\times$ faster than the state-of-the-art for deep neural network training. For inference on a Transformer model with 18.9 million parameters, our attention-specific optimizations enable Spin to achieve better efficiency, less communication, and better accuracy.


title: Active Learning for Graphs with Noisy Structures

abstract: Graph Neural Networks (GNNs) have seen significant success in tasks such as node classification, largely contingent upon the availability of sufficient labeled nodes. Yet, the excessive cost of labeling large-scale graphs led to a focus on active learning on graphs, which aims for effective data selection to maximize downstream model performance. Notably, most existing methods assume reliable graph topology, while real-world scenarios often present noisy graphs. Given this, designing a successful active learning framework for noisy graphs is highly needed but challenging, as selecting data for labeling and obtaining a clean graph are two tasks naturally interdependent: selecting high-quality data requires clean graph structure while cleaning noisy graph structure requires sufficient labeled data. Considering the complexity mentioned above, we propose an active learning framework, GALClean, which has been specifically designed to adopt an iterative approach for conducting both data selection and graph purification simultaneously with best information learned from the prior iteration. Importantly, we summarize GALClean as an instance of the Expectation-Maximization algorithm, which provides a theoretical understanding of its design and mechanisms. This theory naturally leads to an enhanced version, GALClean+. Extensive experiments have demonstrated the effectiveness and robustness of our proposed method across various types and levels of noisy graphs.


title: Dynamic Incremental Optimization for Best Subset Selection

abstract: Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-smooth non-convex problem. In this paper, we investigate the dual forms of a family of $\ell_0$-regularized problems. An efficient primal-dual algorithm is developed based on the primal and dual problem structures. By leveraging the dual range estimation along with the incremental strategy, our algorithm potentially reduces redundant computation and improves the solutions of best subset selection. Theoretical analysis and experiments on synthetic and real-world datasets validate the efficiency and statistical properties of the proposed solutions.


title: Infrared Optical Anisotropy in Quasi-1D Hexagonal Chalcogenide BaTiSe3

abstract: Polarimetric infrared detection bolsters IR thermography by leveraging the polarization of light. Optical anisotropy, i.e., birefringence and dichroism, can be leveraged to achieve polarimetric detection. Recently, giant optical anisotropy was discovered in quasi-1D narrow-bandgap hexagonal perovskite sulfides, A1+xTiS3, specifically BaTiS3[1,2] and Sr9/8TiS3[3,4]. In these materials, the critical role of atomic-scale structure modulations[4,5] in the unconventional electrical[5,6], optical[7,8], and thermal[7,9] properties raises the broader question of other materials that belong to this family. To address this issue, for the first time, we synthesized high-quality single crystals of a largely unexplored member of the A1+xTiX3 (X = S, Se) family, BaTiSe3. Single-crystal X-ray diffraction determined the room-temperature structure with the P31c space group, which is a superstructure of the earlier reported[10] P63/mmc structure. The crystal structure of BaTiSe3 features antiparallel c-axis displacements similar to BaTiS3,[2] but is of lower symmetry. Polarization-resolved Raman and Fourier transform infrared (FTIR) spectroscopy were used to characterize the optical anisotropy of BaTiSe3, whose refractive index along the ordinary (perpendicular to c) and extraordinary (parallel to c) optical axes was quantitatively determined by combining ellipsometry studies with FTIR. With a giant birefringence {\Delta}n~0.9, BaTiSe3 emerges as a new candidate for miniaturized birefringent optics for mid-wave infrared to long-wave infrared imaging.


title: Some factorization results for bivariate polynomials

abstract: We provide upper bounds on the total number of irreducible factors, and in particular irreducibility criteria for some classes of bivariate polynomials $f(x,y)$ over an arbitrary field $\mathbb{K}$. Our results rely on information on the degrees of the coefficients of $f$, and on information on the factorization of the constant term and of the leading coefficient of $f$, viewed as a polynomial in $y$ with coefficients in $\mathbb{K}[x]$. In particular, we provide a generalization of the bivariate version of Perron's irreducibility criterion, and similar results for polynomials in an arbitrary number of indeterminates. The proofs use non-Archimedean absolute values, that are suitable for finding information on the location of the roots of $f$ in an algebraic closure of $\mathbb{K}(x)$.


title: Role of Momentum in Smoothing Objective Function and Generalizability of Deep Neural Networks

abstract: For nonconvex objective functions, including deep neural networks, stochastic gradient descent (SGD) with momentum has fast convergence and excellent generalizability, but a theoretical explanation for this is lacking. In contrast to previous studies that defined the stochastic noise that occurs during optimization as the variance of the stochastic gradient, we define it as the gap between the search direction of the optimizer and the steepest descent direction and show that its level dominates generalizability of the model. We also show that the stochastic noise in SGD with momentum smoothes the objective function, the degree of which is determined by the learning rate, the batch size, the momentum factor, the variance of the stochastic gradient, and the upper bound of the gradient norm. By numerically deriving the stochastic noise level in SGD and SGD with momentum, we provide theoretical findings that help explain the training dynamics of SGD with momentum, which were not explained by previous studies on convergence and stability. We also provide experimental results supporting our assertion that model generalizability depends on the stochastic noise level.


title: Watt-level all polarization-maintaining femtosecond fiber laser source at 1100 nm for multicolor two-photon fluorescence excitation of fluorescent proteins

abstract: We demonstrate a compact watt-level all polarization-maintaining (PM) femtosecond fiber laser source at 1100 nm. The fiber laser source is seeded by an all PM fiber mode-locked laser employing a nonlinear amplifying loop mirror. The seed laser can generate stable pulses at a fundamental repetition rate of 40.71 MHz with a signal-to-noise rate of >100 dB and an integrated relative intensity noise of only ~0.061%. After two-stage external amplification and pulse compression, an output power of ~1.47 W (corresponding to a pulse energy of ~36.1 nJ) and a pulse duration of ~251 fs are obtained. The 1100 nm femtosecond fiber laser is then employed as the excitation light source for multicolor multi-photon fluorescence microscopy of Chinese hamster ovary (CHO) cells stably expressing red fluorescent proteins.


title: Bootstrapping Audio-Visual Segmentation by Strengthening Audio Cues

abstract: How to effectively interact audio with vision has garnered considerable interest within the multi-modality research field. Recently, a novel audio-visual segmentation (AVS) task has been proposed, aiming to segment the sounding objects in video frames under the guidance of audio cues. However, most existing AVS methods are hindered by a modality imbalance where the visual features tend to dominate those of the audio modality, due to a unidirectional and insufficient integration of audio cues. This imbalance skews the feature representation towards the visual aspect, impeding the learning of joint audio-visual representations and potentially causing segmentation inaccuracies. To address this issue, we propose AVSAC. Our approach features a Bidirectional Audio-Visual Decoder (BAVD) with integrated bidirectional bridges, enhancing audio cues and fostering continuous interplay between audio and visual modalities. This bidirectional interaction narrows the modality imbalance, facilitating more effective learning of integrated audio-visual representations. Additionally, we present a strategy for audio-visual frame-wise synchrony as fine-grained guidance of BAVD. This strategy enhances the share of auditory components in visual features, contributing to a more balanced audio-visual representation learning. Extensive experiments show that our method attains new benchmarks in AVS performance.


title: Sample Complexity of Algorithm Selection Using Neural Networks and Its Applications to Branch-and-Cut

abstract: Data-driven algorithm design is a paradigm that uses statistical and machine learning techniques to select from a class of algorithms for a computational problem an algorithm that has the best expected performance with respect to some (unknown) distribution on the instances of the problem. We build upon recent work in this line of research by considering the setup where, instead of selecting a single algorithm that has the best performance, we allow the possibility of selecting an algorithm based on the instance to be solved, using neural networks. In particular, given a representative sample of instances, we learn a neural network that maps an instance of the problem to the most appropriate algorithm for that instance. We formalize this idea and derive rigorous sample complexity bounds for this learning problem, in the spirit of recent work in data-driven algorithm design. We then apply this approach to the problem of making good decisions in the branch-and-cut framework for mixed-integer optimization (e.g., which cut to add?). In other words, the neural network will take as input a mixed-integer optimization instance and output a decision that will result in a small branch-and-cut tree for that instance. Our computational results provide evidence that our particular way of using neural networks for cut selection can make a significant impact in reducing branch-and-cut tree sizes, compared to previous data-driven approaches.


title: Leveraging Local Distributions in Mendelian Randomization: Uncertain Opinions are Invalid

abstract: Mendelian randomization (MR) considers using genetic variants as instrumental variables (IVs) to infer causal effects in observational studies. However, the validity of causal inference in MR can be compromised when the IVs are potentially invalid. In this work, we propose a new method, MR-Local, to infer the causal effect in the existence of possibly invalid IVs. By leveraging the distribution of ratio estimates around the true causal effect, MR-Local selects the cluster of ratio estimates with the least uncertainty and performs causal inference within it. We establish the asymptotic normality of our estimator in the two-sample summary-data setting under either the plurality rule or the balanced pleiotropy assumption. Extensive simulations and analyses of real datasets demonstrate the reliability of our approach.


title: Enhance Reasoning for Large Language Models in the Game Werewolf

abstract: This paper presents an innovative framework that integrates Large Language Models (LLMs) with an external Thinker module to enhance the reasoning capabilities of LLM-based agents. Unlike augmenting LLMs with prompt engineering, Thinker directly harnesses knowledge from databases and employs various optimization techniques. The framework forms a reasoning hierarchy where LLMs handle intuitive System-1 tasks such as natural language processing, while the Thinker focuses on cognitive System-2 tasks that require complex logical analysis and domain-specific knowledge. Our framework is presented using a 9-player Werewolf game that demands dual-system reasoning. We introduce a communication protocol between LLMs and the Thinker, and train the Thinker using data from 18800 human sessions and reinforcement learning. Experiments demonstrate the framework's effectiveness in deductive reasoning, speech generation, and online game evaluation. Additionally, we fine-tune a 6B LLM to surpass GPT4 when integrated with the Thinker. This paper also contributes the largest dataset for social deduction games to date.


title: General Relativistic Hydrodynamics in Discrete Spacetime: Perfect Fluid Accretion onto Static and Spinning Black Holes

abstract: We study the problem of a spherically-symmetric distribution of a perfect relativistic fluid accreting onto a (potentially spinning) black hole within a fully discrete spacetime setting. This problem has previously been studied extensively in the context of continuum spacetimes, beginning with the purely analytic work of Bondi in the spherically-symmetric Newtonian case, Michel in the spherically-symmetric general relativistic case, and Petrich, Shapiro and Teukolsky in the axially-symmetric general relativistic case relevant for spinning black holes. However, the purpose of the present work is to determine the effect of discretization of the underlying spacetime upon the mass/energy and momentum accretion rates, the overall morphology and characteristics of the accretion flow, and the drag force exerted on the black hole in the case of non-zero spin. In order to achieve this, we first develop a novel formulation of the equations of general relativistic hydrodynamics that is more directly amenable to rigorous analysis within a discrete spacetime setting, and we then proceed to implement this formulation into the Gravitas computational general relativity framework. Through a combination of mathematical analysis and explicit numerical simulation in Gravitas, we discover that the mass/energy and momentum accretion rates both decrease monotonically as functions of the underlying spacetime discretization scale, with this effect becoming more pronounced for higher values of the black hole spin parameter, higher fluid temperatures, and stiffer equation of state parameters. We also find that the exerted drag force is highly sensitive to the value of the underlying discretization scale in the case of spinning black hole spacetimes, with certain instabilities becoming significantly more pronounced at certain critical values of the discretization parameter.


title: Minusformer: Improving Time Series Forecasting by Progressively Learning Residuals

abstract: In this paper, we find that ubiquitous time series (TS) forecasting models are prone to severe overfitting. To cope with this problem, we embrace a de-redundancy approach to progressively reinstate the intrinsic values of TS for future intervals. Specifically, we introduce a dual-stream and subtraction mechanism, which is a deep Boosting ensemble learning method. And the vanilla Transformer is renovated by reorienting the information aggregation mechanism from addition to subtraction. Then, we incorporate an auxiliary output branch into each block of the original model to construct a highway leading to the ultimate prediction. The output of subsequent modules in this branch will subtract the previously learned results, enabling the model to learn the residuals of the supervision signal, layer by layer. This designing facilitates the learning-driven implicit progressive decomposition of the input and output streams, empowering the model with heightened versatility, interpretability, and resilience against overfitting. Since all aggregations in the model are minus signs, which is called Minusformer. Extensive experiments demonstrate the proposed method outperform existing state-of-the-art methods, yielding an average performance improvement of 11.9% across various datasets.The code has been released at https://github.com/Anoise/Minusformer.


title: Copyright Protection in Generative AI: A Technical Perspective

abstract: Generative AI has witnessed rapid advancement in recent years, expanding their capabilities to create synthesized content such as text, images, audio, and code. The high fidelity and authenticity of contents generated by these Deep Generative Models (DGMs) have sparked significant copyright concerns. There have been various legal debates on how to effectively safeguard copyrights in DGMs. This work delves into this issue by providing a comprehensive overview of copyright protection from a technical perspective. We examine from two distinct viewpoints: the copyrights pertaining to the source data held by the data owners and those of the generative models maintained by the model builders. For data copyright, we delve into methods data owners can protect their content and DGMs can be utilized without infringing upon these rights. For model copyright, our discussion extends to strategies for preventing model theft and identifying outputs generated by specific models. Finally, we highlight the limitations of existing techniques and identify areas that remain unexplored. Furthermore, we discuss prospective directions for the future of copyright protection, underscoring its importance for the sustainable and ethical development of Generative AI.


title: Arithmetic Feature Interaction Is Necessary for Deep Tabular Learning

abstract: Until recently, the question of the effective inductive bias of deep models on tabular data has remained unanswered. This paper investigates the hypothesis that arithmetic feature interaction is necessary for deep tabular learning. To test this point, we create a synthetic tabular dataset with a mild feature interaction assumption and examine a modified transformer architecture enabling arithmetical feature interactions, referred to as AMFormer. Results show that AMFormer outperforms strong counterparts in fine-grained tabular data modeling, data efficiency in training, and generalization. This is attributed to its parallel additive and multiplicative attention operators and prompt-based optimization, which facilitate the separation of tabular samples in an extended space with arithmetically-engineered features. Our extensive experiments on real-world data also validate the consistent effectiveness, efficiency, and rationale of AMFormer, suggesting it has established a strong inductive bias for deep learning on tabular data. Code is available at https://github.com/aigc-apps/AMFormer.


title: Video Editing for Video Retrieval

abstract: Though pre-training vision-language models have demonstrated significant benefits in boosting video-text retrieval performance from large-scale web videos, fine-tuning still plays a critical role with manually annotated clips with start and end times, which requires considerable human effort. To address this issue, we explore an alternative cheaper source of annotations, single timestamps, for video-text retrieval. We initialise clips from timestamps in a heuristic way to warm up a retrieval model. Then a video clip editing method is proposed to refine the initial rough boundaries to improve retrieval performance. A student-teacher network is introduced for video clip editing. The teacher model is employed to edit the clips in the training set whereas the student model trains on the edited clips. The teacher weights are updated from the student's after the student's performance increases. Our method is model agnostic and applicable to any retrieval models. We conduct experiments based on three state-of-the-art retrieval models, COOT, VideoCLIP and CLIP4Clip. Experiments conducted on three video retrieval datasets, YouCook2, DiDeMo and ActivityNet-Captions show that our edited clips consistently improve retrieval performance over initial clips across all the three retrieval models.


title: Quantitative particle approximations of stochastic 2D Navier-Stokes equation

abstract: In this article, we investigate an interacting particle system featuring random intensities, individual noise, and environmental noise, commonly referred to as stochastic point vortex model. The model serves as an approximation for the stochastic 2-dimensional Navier-Stokes equation. We establish a quantitative mean-field convergence for the stochastic 2-dimensional Navier-Stokes equation in the form of relative entropy. To address challenges posed by environmental noise, random intensities, and singular kernel, we compare relative entropy for conditional distributions, employing technology of disintegration and the relative entropy method developed by Jabin and Wang in [JW18].


title: Eigen Is All You Need: Efficient Lidar-Inertial Continuous-Time Odometry with Internal Association

abstract: In this paper, we propose a continuous-time lidar-inertial odometry (CT-LIO) system named SLICT2, which promotes two main insights. One, contrary to conventional wisdom, CT-LIO algorithm can be optimized by linear solvers in only a few iterations, which is more efficient than commonly used nonlinear solvers. Two, CT-LIO benefits more from the correct association than the number of iterations. Based on these ideas, we implement our method with a customized solver where the feature association process is performed immediately after each incremental step, and the solution can converge within a few iterations. Our implementation can achieve real-time performance with a high density of control points while yielding competitive performance in highly dynamical motion scenarios. We demonstrate the advantages of our method by comparing with other existing state-of-the-art CT-LIO methods. The source code will be released for the benefit of the community.


title: NetLLM: Adapting Large Language Models for Networking

abstract: Many networking tasks now employ deep learning (DL) to solve complex prediction and system optimization problems. However, current design philosophy of DL-based algorithms entails intensive engineering overhead due to the manual design of deep neural networks (DNNs) for different networking tasks. Besides, DNNs tend to achieve poor generalization performance on unseen data distributions/environments. Motivated by the recent success of large language models (LLMs), for the first time, this work studies the LLM adaptation for networking to explore a more sustainable design philosophy. With the massive pre-trained knowledge and powerful inference ability, LLM can serve as the foundation model, and is expected to achieve "one model for all" with even better performance and stronger generalization for various tasks. In this paper, we present NetLLM, the first LLM adaptation framework that efficiently adapts LLMs to solve networking problems. NetLLM addresses many practical challenges in LLM adaptation, from how to process task-specific information with LLMs, to how to improve the efficiency of answer generation and acquiring domain knowledge for networking. Across three networking-related use cases - viewport prediction (VP), adaptive bitrate streaming (ABR) and cluster job scheduling (CJS), we demonstrate the effectiveness of NetLLM in LLM adaptation for networking, and showcase that the adapted LLM significantly outperforms state-of-the-art algorithms.


title: Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation

abstract: Although data-driven methods have achieved success in 3D human pose estimation, they often suffer from domain gaps and exhibit limited generalization. In contrast, optimization-based methods excel in fine-tuning for specific cases but are generally inferior to data-driven methods in overall performance. We observe that previous optimization-based methods commonly rely on projection constraint, which only ensures alignment in 2D space, potentially leading to the overfitting problem. To address this, we propose an Uncertainty-Aware testing-time Optimization (UAO) framework, which keeps the prior information of pre-trained model and alleviates the overfitting problem using the uncertainty of joints. Specifically, during the training phase, we design an effective 2D-to-3D network for estimating the corresponding 3D pose while quantifying the uncertainty of each 3D joint. For optimization during testing, the proposed optimization framework freezes the pre-trained model and optimizes only a latent state. Projection loss is then employed to ensure the generated poses are well aligned in 2D space for high-quality optimization. Furthermore, we utilize the uncertainty of each joint to determine how much each joint is allowed for optimization. The effectiveness and superiority of the proposed framework are validated through extensive experiments on two challenging datasets: Human3.6M and MPI-INF-3DHP. Notably, our approach outperforms the previous best result by a large margin of 4.5% on Human3.6M. Our source code will be open-sourced.


title: Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning

abstract: Deep Metric Learning (DML) has long attracted the attention of the machine learning community as a key objective. Existing solutions concentrate on fine-tuning the pre-trained models on conventional image datasets. As a result of the success of recent pre-trained models trained from larger-scale datasets, it is challenging to adapt the model to the DML tasks in the local data domain while retaining the previously gained knowledge. In this paper, we investigate parameter-efficient methods for fine-tuning the pre-trained model for DML tasks. In particular, we propose a novel and effective framework based on learning Visual Prompts (VPT) in the pre-trained Vision Transformers (ViT). Based on the conventional proxy-based DML paradigm, we augment the proxy by incorporating the semantic information from the input image and the ViT, in which we optimize the visual prompts for each class. We demonstrate that our new approximations with semantic information are superior to representative capabilities, thereby improving metric learning performance. We conduct extensive experiments to demonstrate that our proposed framework is effective and efficient by evaluating popular DML benchmarks. In particular, we demonstrate that our fine-tuning method achieves comparable or even better performance than recent state-of-the-art full fine-tuning works of DML while tuning only a small percentage of total parameters.


title: Untangle charge-order dependent bulk states from surface effects in a topological kagome metal ScV$_6$Sn$_6$

abstract: Kagome metals with charge density wave (CDW) order exhibit a broad spectrum of intriguing quantum phenomena. The recent discovery of the novel kagome CDW compound ScV$_6$Sn$_6$ has spurred significant interest. However, understanding the interplay between CDW and the bulk electronic structure has been obscured by a profusion of surface states and terminations in this quantum material. Here, we employ photoemission spectroscopy and potassium dosing to elucidate the complete bulk band structure of ScV$_6$Sn$_6$, revealing multiple van Hove singularities near the Fermi level. We surprisingly discover a robust spin-polarized topological Dirac surface resonance state at the M point within the two-fold van Hove singularities. Assisted by the first-principle calculations, the temperature dependence of the $k_z$- resolved ARPES spectrum provides unequivocal evidence for the proposed $\sqrt{3}$$\times$$\sqrt{3}$$\times3$ charge order over other candidates. Our work not only enhances the understanding of the CDW-dependent bulk and surface states in ScV$_6$Sn$_6$ but also establishes an essential foundation for potential manipulation of the CDW order in kagome materials.


title: MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters

abstract: This paper addresses the challenge of optimizing meta-parameters (i.e., hyperparameters) in machine learning algorithms, a critical factor influencing training efficiency and model performance. Moving away from the computationally expensive traditional meta-parameter search methods, we introduce MetaOptimize framework that dynamically adjusts meta-parameters, particularly step sizes (also known as learning rates), during training. More specifically, MetaOptimize can wrap around any first-order optimization algorithm, tuning step sizes on the fly to minimize a specific form of regret that accounts for long-term effect of step sizes on training, through a discounted sum of future losses. We also introduce low complexity variants of MetaOptimize that, in conjunction with its adaptability to multiple optimization algorithms, demonstrate performance competitive to those of best hand-crafted learning rate schedules across various machine learning applications.


title: Noise mitigation in quantum teleportation

abstract: Permitting the transmission of unknown quantum states over long distances by using entanglement, quantum teleportation serves as an important building block for many quantum technologies. However, in the noisy intermediate-scale quantum era, the practical realization of quantum teleportation is inevitably challenged by the noise-induced decoherence. We here propose a noise mitigation mechanism applicable in both the discrete- and continuous-variable quantum teleportation schemes. Via investigating the non-Markovian decoherence dynamics of the two types of quantum teleportation schemes, we find that, as long as a bound state is formed in the energy spectrum of the total system consisting of the involved subsystems and their respective reservoirs, the quantum superiority of the fidelity is persistently recovered. Supplying an insightful understanding on the noise mitigation protocols, our result paves the way to the practical realization of noise-tolerant quantum teleportation.


title: On Secure mmWave RSMA Systems

abstract: This work considers a multiple-input-single-output mmWave RSMA system wherein a base station serves two users in the presence of a passive eavesdropper. Different eavesdropping scenarios are considered corresponding to the overlapped resolvable paths between the main and the wiretap channels under the considered transmission schemes. The analytical expressions for the secrecy outage probability are derived respectively through the Gaussian Chebyshev quadrature method. Monte Carlo simulation results are presented to validate the correctness of the derived analytical expressions and demonstrate the effects of system parameters on the SOP of the considered mmWave RSMA systems.


title: Stereographic Spherical Sliced Wasserstein Distances

abstract: Comparing spherical probability distributions is of great interest in various fields, including geology, medical domains, computer vision, and deep representation learning. The utility of optimal transport-based distances, such as the Wasserstein distance, for comparing probability measures has spurred active research in developing computationally efficient variations of these distances for spherical probability measures. This paper introduces a high-speed and highly parallelizable distance for comparing spherical measures using the stereographic projection and the generalized Radon transform, which we refer to as the Stereographic Spherical Sliced Wasserstein (S3W) distance. We carefully address the distance distortion caused by the stereographic projection and provide an extensive theoretical analysis of our proposed metric and its rotationally invariant variation. Finally, we evaluate the performance of the proposed metrics and compare them with recent baselines in terms of both speed and accuracy through a wide range of numerical studies, including gradient flows and self-supervised learning. Our code is available at https://github.com/mint-vu/s3wd.


title: Closed-Loop Unsupervised Representation Disentanglement with $\beta$-VAE Distillation and Diffusion Probabilistic Feedback

abstract: Representation disentanglement may help AI fundamentally understand the real world and thus benefit both discrimination and generation tasks. It currently has at least three unresolved core issues: (i) heavy reliance on label annotation and synthetic data -- causing poor generalization on natural scenarios; (ii) heuristic/hand-craft disentangling constraints make it hard to adaptively achieve an optimal training trade-off; (iii) lacking reasonable evaluation metric, especially for the real label-free data. To address these challenges, we propose a \textbf{C}losed-\textbf{L}oop unsupervised representation \textbf{Dis}entanglement approach dubbed \textbf{CL-Dis}. Specifically, we use diffusion-based autoencoder (Diff-AE) as a backbone while resorting to $\beta$-VAE as a co-pilot to extract semantically disentangled representations. The strong generation ability of diffusion model and the good disentanglement ability of VAE model are complementary. To strengthen disentangling, VAE-latent distillation and diffusion-wise feedback are interconnected in a closed-loop system for a further mutual promotion. Then, a self-supervised \textbf{Navigation} strategy is introduced to identify interpretable semantic directions in the disentangled latent space. Finally, a new metric based on content tracking is designed to evaluate the disentanglement effect. Experiments demonstrate the superiority of CL-Dis on applications like real image manipulation and visual analysis.


title: Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models

abstract: Low-Rank Adaptation (LoRA) emerges as a popular parameter-efficient fine-tuning (PEFT) method, which proposes to freeze pretrained model weights and update an additive low-rank trainable matrix. In this work, we study the enhancement of LoRA training by introducing an $r \times r$ preconditioner in each gradient step where $r$ is the LoRA rank. We theoretically verify that the proposed preconditioner stabilizes feature learning with LoRA under infinite-width NN setting. Empirically, the implementation of this new preconditioner requires a small change to existing optimizer code and creates virtually minuscule storage and runtime overhead. Our experimental results with both large language models and text-to-image diffusion models show that with this new preconditioner, the convergence and reliability of SGD and AdamW can be significantly enhanced. Moreover, the training process becomes much more robust to hyperparameter choices such as learning rate. The new preconditioner can be derived from a novel Riemannian metric in low-rank matrix field. Code can be accessed at https://github.com/pilancilab/Riemannian_Preconditioned_LoRA.


title: System size and shape dependences of collective flow fluctuations in relativistic nuclear collisions

abstract: Quantum fluctuations plays an essential role in forming the collective flow of hadrons observed in relativistic heavy-ion collisions. Event-by-event fluctuations of the collective flow can arise from various sources, such as the fluctuations in the initial geometry, hydrodynamic expansion, hadronization and hadronic evolution of the nuclear matter, while the exact contribution from each source is still an open question. Using a (3+1)-dimensional relativistic hydrodynamic model coupled to a Monte-Carlo Glauber initial condition, Cooper-Frye particlization and a hadronic transport model, we explore the system size and shape dependences of the collective flow fluctuations in Au+Au, Cu+Au and O+O collisions at $\sqrt{s_\mathrm{NN}}=200$ GeV. The particle yields, mean transverse momenta, 2-particle and 4-particle cumulant elliptic flows ($v_2\{2\}$ and $v_2\{4\}$) from our calculation agree with the currently existing data from RHIC. Different centrality dependences of the flow fluctuations, quantified by the $v_2\{4\}/v_2\{2\}$ ratio, are found for different collision systems due to their different sizes and shapes. By comparing $v_2\{4\}/v_2\{2\}$ between different hadron species, and comparing $v_2\{4\}/v_2\{2\}$ to the initial state geometric fluctuations quantified by the cumulant eccentricity ratio $\varepsilon_2\{4\}/\varepsilon_2\{2\}$, we find that while the initial state fluctuations are the main source of the $v_2$ fluctuations in large collision systems, other sources like hadronization and hadronic afterburner can significantly affect the $v_2$ fluctuations in small systems.


title: Vision Transformer-based Multimodal Feature Fusion Network for Lymphoma Segmentation on PET/CT Images

abstract: Background: Diffuse large B-cell lymphoma (DLBCL) segmentation is a challenge in medical image analysis. Traditional segmentation methods for lymphoma struggle with the complex patterns and the presence of DLBCL lesions. Objective: We aim to develop an accurate method for lymphoma segmentation with 18F-Fluorodeoxyglucose positron emission tomography (PET) and computed tomography (CT) images. Methods: Our lymphoma segmentation approach combines a vision transformer with dual encoders, adeptly fusing PET and CT data via multimodal cross-attention fusion (MMCAF) module. In this study, PET and CT data from 165 DLBCL patients were analyzed. A 5-fold cross-validation was employed to evaluate the performance and generalization ability of our method. Ground truths were annotated by experienced nuclear medicine experts. We calculated the total metabolic tumor volume (TMTV) and performed a statistical analysis on our results. Results: The proposed method exhibited accurate performance in DLBCL lesion segmentation, achieving a Dice similarity coefficient of 0.9173$\pm$0.0071, a Hausdorff distance of 2.71$\pm$0.25mm, a sensitivity of 0.9462$\pm$0.0223, and a specificity of 0.9986$\pm$0.0008. Additionally, a Pearson correlation coefficient of 0.9030$\pm$0.0179 and an R-square of 0.8586$\pm$0.0173 were observed in TMTV when measured on manual annotation compared to our segmentation results. Conclusion: This study highlights the advantages of MMCAF and vision transformer for lymphoma segmentation using PET and CT, offering great promise for computer-aided lymphoma diagnosis and treatment.


title: Interference-Aware Emergent Random Access Protocol for Downlink LEO Satellite Networks

abstract: In this article, we propose a multi-agent deep reinforcement learning (MADRL) framework to train a multiple access protocol for downlink low earth orbit (LEO) satellite networks. By improving the existing learned protocol, emergent random access channel (eRACH), our proposed method, coined centralized and compressed emergent signaling for eRACH (Ce2RACH), can mitigate inter-satellite interference by exchanging additional signaling messages jointly learned through the MADRL training process. Simulations demonstrate that Ce2RACH achieves up to 36.65% higher network throughput compared to eRACH, while the cost of signaling messages increase linearly with the number of users.


title: Effective model and electron correlations in trilayer nickelate superconductor La$_4$Ni$_3$O$_{10}$

abstract: Recently, signatures of superconductivity with critical temperature from 20 to 30 K have been reported in pressured trilayer nickelate La$_4$Ni$_3$O$_{10}$ through a pressure-induced structure transition. Here we explore the evolution of electronic structures and electronic correlations in different phases of La$_4$Ni$_3$O$_{10}$ under corresponding pressure regions, by using density functional theory (DFT) combined with dynamical mean-field theory (DMFT). Similar to bilayer superconductor La$_3$Ni$_2$O$_{7}$, the electronic bands in superconducting La$_4$Ni$_3$O$_{10}$ are dominated by Ni-3$d_{x^2-y^2}$ and 3$d_{z^2}$ orbits near the Fermi level, in contrast, the inner Ni-O plane in La$_4$Ni$_3$O$_{10}$ generates a doublet hole-pocket Fermi surfaces around the Brillouin-zone corner, meanwhile one branch of the Ni-$3d_{z^2}$ bands is pushed very close above the Fermi level, which can induce an electron pocket through small electron doping. The DFT+DMFT simulations suggest that the electronic correlations only give minor modification to the Fermi surfaces, meanwhile the Ni-$3d_{z^2}$ and 3$d_{x^2-y^2}$ states on outer Ni-O layers have considerable greater mass enhancements than on the inner layer. The sensitiveness of electronic structure under doping and unique layer dependence of correlation suggest a distinct superconducting mechanism with respect to bilayer La$_3$Ni$_2$O$_{7}$. Based on the DFT and DFT+DMFT simulations, we eventually derive a trilayer effective tight-binding model, which can produce rather precise electronic bands and Fermi surfaces, hence can serve as an appropriate model to further study the superconducting mechanism and paring symmetry in trilayer La$_4$Ni$_3$O$_{10}$.


title: Region-Based Representations Revisited

abstract: We investigate whether region-based representations are effective for recognition. Regions were once a mainstay in recognition approaches, but pixel and patch-based features are now used almost exclusively. We show that recent class-agnostic segmenters like SAM can be effectively combined with strong unsupervised representations like DINOv2 and used for a wide variety of tasks, including semantic segmentation, object-based image retrieval, and multi-image analysis. Once the masks and features are extracted, these representations, even with linear decoders, enable competitive performance, making them well suited to applications that require custom queries. The compactness of the representation also makes it well-suited to video analysis and other problems requiring inference across many images.


title: Intrinsic bispectrum of the scalar-induced gravitational waves

abstract: Recent pulsar timing array collaborations have reported evidence of the stochastic gravitational wave background. The gravitational waves induced by primordial curvature perturbations, referred to as scalar-induced gravitational waves (SIGWs), could potentially be the physical origins of this gravitational wave background. In addition to the statistical properties of SIGWs derived from the primordial fluctuations, SIGWs also have intrinsic non-Gaussianity originating from the non-linear interactions of Einstein's gravity, which, however, is rarely explored. In this paper, we study the intrinsic non-Gaussianity of SIGWs with the bispectrum and the skewness under the assumption of the Gaussian primordial curvature perturbations, phenomenologically modeled as a lognormal spectrum. The bispectrum is shown to be vanishing in the collinear limit, which is independent of the initial conditions and the dynamics of SIGWs. For the SIGWs generated during the radiation-dominated era, the bispectrum is of flatten-type non-Gaussianity, with only four polarization components left to be non-vanishing. Additionally, in order to obtain the correct bispectrum, we also propose a time-oscillation average scheme and a regularization scheme. Utilizing the skewness for quantifying the degree of non-Gaussianity, it is found that the curvature power spectrum with a narrow width can result in an enhancement of the third-order non-Gaussianity. The conclusion holds for both the SIGWs generated in the radiation-dominated era and the matter-dominated era.


title: A Paradigm for Potential Model Performance Improvement in Classification and Regression Problems. A Proof of Concept

abstract: A methodology that seeks to enhance model prediction performance is presented. The method involves generating multiple auxiliary models that capture relationships between attributes as a function of each other. Such information serves to generate additional informative columns in the dataset that can potentially enhance target prediction. A proof of case and related code is provided.