title: Quasi-regular variations of subpulse drifting for PSR J1857+0057

abstract: During observations of the Galactic Plane Pulsar Snapshot (GPPS) survey by the Five-hundred-meter Aperture Spherical radio Telescope (FAST), varying subpulses drifting of PSR J1857+0057 is detected. The following-up observation confirms the quasi-regularly changes of the drifting rate about every 50 periods. We determine the drift rate $D$ through a linear fit to the pulse-central longitudes of subpulses in a drifting band, and determine $P_3$ from the cross-points of two fitted lines at the zero longitude for two neighbored drifting bands. The low frequency modulation of about every 50 periods is found on variations of not only pulse intensity but also drift parameters. In most of low frequency modulation cycles, the integrated pulse intensity $I$ and the absolute drift rate $|D|$ tend to increase first and then decrease, and the drifting periodicity $P_3$ varies just in the opposite. In addition, the phase-forward intensity-enhancement is observed in many modulation cycles. Based on our polarization data, the average PA curve for pulses with a smaller $|D|$ and larger $P_3$ is slightly steep in the leading edge of pulse profile compared with that of the fully averaged profile.


title: Quasi-Monte Carlo for unbounded integrands with importance sampling

abstract: We consider the problem of estimating an expectation $ \mathbb{E}\left[ h(W)\right]$ by quasi-Monte Carlo (QMC) methods, where $ h $ is an unbounded smooth function on $ \mathbb{R}^d $ and $ W$ is a standard normal distributed random variable. To study rates of convergence for QMC on unbounded integrands, we use a smoothed projection operator to project the output of $W$ to a bounded region, which differs from the strategy of avoiding the singularities along the boundary of the unit cube $ [0,1]^d $ in 10.1137/S0036144504441573. The error is then bounded by the quadrature error of the transformed integrand and the projection error. If the function $h(\boldsymbol{x})$ and its mixed partial derivatives do not grow too fast as the Euclidean norm $|\boldsymbol{x}|$ goes to infinity, we obtain an error rate of $O(n^{-1+\epsilon})$ for QMC and randomized QMC (RQMC) with a sample size $n$ and an arbitrarily small $\epsilon>0$. However, the rate turns out to be $O(n^{-1+2M+\epsilon})$ if the functions grow exponentially with a rate of $O(\exp\{M|\boldsymbol{x}|^2\})$ for a constant $M\in(0,1/2)$. Superisingly, we find that using importance sampling with t distribution as the proposal can improve the root mean squared error of RQMC from $O(n^{-1+2M+\epsilon})$ to $O( n^{-3/2+\epsilon})$ for any $M\in(0,1/2)$.


title: A lifting principle for canonical stability indices of varieties of general type

abstract: For any integer $n>0$, the $n$th canonical stability index $r_n$ is defined to be the smallest positive integer so that the $r_n$-canonical map $\Phi_{r_n}$ is stably birational onto its image for all smooth projective $n$-folds of general type. We prove the lifting principle for $\{r_n\}$ as follows: $r_n$ equals to the maximum of the set of those canonical stability indices of smooth projective $(n+1)$-folds with sufficiently large canonical volumes. Equivalently, there exists a constant $\mathfrak{V}(n)>0$ such that, for any smooth projective $n$-fold $X$ with the canonical volume $\textrm{vol}(X)>{\mathfrak V}(n)$, the pluricanonical map $\varphi_{m,X}$ is birational onto the image for all $m\geq r_{n-1}$. The ''lifting principle'' was first put forward by James McKernan in Mathematics Review (MR2339333).


title: Allotropic transition of Dirac semimetal {\alpha}-Sn to superconductor {\beta}-Sn induced by irradiation of focused ion beam

abstract: Diamond-type structure allotrope {\alpha}-Sn is attracting much attention as a topological Dirac semimetal (TDS). In this study, we demonstrate that {\alpha}-Sn undergoes a phase transition to another allotrope {\beta}-Sn with superconductivity at low temperature by irradiating with a focused Ga ion beam (FIB). To clarify the transition mechanism, we performed X-ray photoemission spectroscopy (XPS) measurements on an {\alpha}-Sn thin film irradiated with FIB and an as-grown {\alpha}-Sn thin film. The XPS results suggest that the local annealing, which is one of the side effects of FIB, causes the transformation from {\alpha}-Sn into {\beta}-Sn. Furthermore, the difference in the chemical states between {\alpha}-Sn and {\beta}-Sn can be quantitatively explained by the crystal structures rather than the degree of metallicity reflecting the conductivity. These results propose a new way of fabricating TDS/superconductor in-plane heterostructures based on {\alpha}-Sn and {\beta}-Sn.


title: Reformulating Vision-Language Foundation Models and Datasets Towards Universal Multimodal Assistants

abstract: Recent Multimodal Large Language Models (MLLMs) exhibit impressive abilities to perceive images and follow open-ended instructions. The capabilities of MLLMs depend on two crucial factors: the model architecture to facilitate the feature alignment of visual modules and large language models; the multimodal instruction tuning datasets for human instruction following. (i) For the model architecture, most existing models introduce an external bridge module to connect vision encoders with language models, which needs an additional feature-alignment pre-training. In this work, we discover that compact pre-trained vision language models can inherently serve as ``out-of-the-box'' bridges between vision and language. Based on this, we propose Muffin framework, which directly employs pre-trained vision-language models to act as providers of visual signals. (ii) For the multimodal instruction tuning datasets, existing methods omit the complementary relationship between different datasets and simply mix datasets from different tasks. Instead, we propose UniMM-Chat dataset which explores the complementarities of datasets to generate 1.1M high-quality and diverse multimodal instructions. We merge information describing the same image from diverse datasets and transforms it into more knowledge-intensive conversation data. Experimental results demonstrate the effectiveness of the Muffin framework and UniMM-Chat dataset. Muffin achieves state-of-the-art performance on a wide range of vision-language tasks, significantly surpassing state-of-the-art models like LLaVA and InstructBLIP. Our model and dataset are all accessible at https://github.com/thunlp/muffin.


title: Streamlining Attack Tree Generation: A Fragment-Based Approach

abstract: Attack graphs are a tool for analyzing security vulnerabilities that capture different and prospective attacks on a system. As a threat modeling tool, it shows possible paths that an attacker can exploit to achieve a particular goal. However, due to the large number of vulnerabilities that are published on a daily basis, they have the potential to rapidly expand in size. Consequently, this necessitates a significant amount of resources to generate attack graphs. In addition, generating composited attack models for complex systems such as self-adaptive or AI is very difficult due to their nature to continuously change. In this paper, we present a novel fragment-based attack graph generation approach that utilizes information from publicly available information security databases. Furthermore, we also propose a domain-specific language for attack modeling, which we employ in the proposed attack graph generation approach. Finally, we present a demonstrator example showcasing the attack generator's capability to replicate a verified attack chain, as previously confirmed by security experts.


title: PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecasting

abstract: Although the Transformer has been the dominant architecture for time series forecasting tasks in recent years, a fundamental challenge remains: the permutation-invariant self-attention mechanism within Transformers leads to a loss of temporal information. To tackle these challenges, we propose PatchMixer, a novel CNN-based model. It introduces a permutation-variant convolutional structure to preserve temporal information. Diverging from conventional CNNs in this field, which often employ multiple scales or numerous branches, our method relies exclusively on depthwise separable convolutions. This allows us to extract both local features and global correlations using a single-scale architecture. Furthermore, we employ dual forecasting heads that encompass both linear and nonlinear components to better model future curve trends and details. Our experimental results on seven time-series forecasting benchmarks indicate that compared with the state-of-the-art method and the best-performing CNN, PatchMixer yields $3.9\%$ and $21.2\%$ relative improvements, respectively, while being 2-3x faster than the most advanced method. We will release our code and model.


title: LEGO-Prover: Neural Theorem Proving with Growing Libraries

abstract: Despite the success of large language models (LLMs), the task of theorem proving still remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods using language models have demonstrated promising results, but they still struggle to prove even middle school level theorems. One common limitation of these methods is that they assume a fixed theorem library during the whole theorem proving process. However, as we all know, creating new useful theorems or even new theories is not only helpful but crucial and necessary for advancing mathematics and proving harder and deeper results. In this work, we present LEGO-Prover, which employs a growing skill library containing verified lemmas as skills to augment the capability of LLMs used in theorem proving. By constructing the proof modularly, LEGO-Prover enables LLMs to utilize existing skills retrieved from the library and to create new skills during the proving process. These skills are further evolved (by prompting an LLM) to enrich the library on another scale. Modular and reusable skills are constantly added to the library to enable tackling increasingly intricate mathematical problems. Moreover, the learned library further bridges the gap between human proofs and formal proofs by making it easier to impute missing steps. LEGO-Prover advances the state-of-the-art pass rate on miniF2F-valid (48.0% to 57.0%) and miniF2F-test (45.5% to 47.1%). During the proving process, LEGO-Prover also manages to generate over 20,000 skills (theorems/lemmas) and adds them to the growing library. Our ablation study indicates that these newly added skills are indeed helpful for proving theorems, resulting in an improvement from a success rate of 47.1% to 50.4%. We also release our code and all the generated skills.


title: High flux strontium atom source

abstract: We present a novel cold strontium atom source designed for quantum sensors. We optimized the deceleration process to capture a large velocity class of atoms emitted from an oven and achieved a compact and low-power setup capable of generating a high atomic flux. Our approach involves velocity-dependent transverse capture of atoms using a two-dimensional magneto-optical trap. To enhance the atomic flux, we employ tailored magnetic fields that minimize radial beam expansion and incorporate a cascaded Zeeman-slowing configuration utilizing two optical frequencies. The performance is comparable to that of conventional Zeeman slower sources, and the scheme is applicable to other atomic species. Our results represent a significant advancement towards the deployment of portable and, possibly, space-based cold atom sensors.


title: The Robots are Here: Navigating the Generative AI Revolution in Computing Education

abstract: Recent advancements in artificial intelligence (AI) are fundamentally reshaping computing, with large language models (LLMs) now effectively being able to generate and interpret source code and natural language instructions. These emergent capabilities have sparked urgent questions in the computing education community around how educators should adapt their pedagogy to address the challenges and to leverage the opportunities presented by this new technology. In this working group report, we undertake a comprehensive exploration of LLMs in the context of computing education and make five significant contributions. First, we provide a detailed review of the literature on LLMs in computing education and synthesise findings from 71 primary articles. Second, we report the findings of a survey of computing students and instructors from across 20 countries, capturing prevailing attitudes towards LLMs and their use in computing education contexts. Third, to understand how pedagogy is already changing, we offer insights collected from in-depth interviews with 22 computing educators from five continents who have already adapted their curricula and assessments. Fourth, we use the ACM Code of Ethics to frame a discussion of ethical issues raised by the use of large language models in computing education, and we provide concrete advice for policy makers, educators, and students. Finally, we benchmark the performance of LLMs on various computing education datasets, and highlight the extent to which the capabilities of current models are rapidly improving. Our aim is that this report will serve as a focal point for both researchers and practitioners who are exploring, adapting, using, and evaluating LLMs and LLM-based tools in computing classrooms.


title: Liveness Detection Competition -- Noncontact-based Fingerprint Algorithms and Systems (LivDet-2023 Noncontact Fingerprint)

abstract: Liveness Detection (LivDet) is an international competition series open to academia and industry with the objec-tive to assess and report state-of-the-art in Presentation Attack Detection (PAD). LivDet-2023 Noncontact Fingerprint is the first edition of the noncontact fingerprint-based PAD competition for algorithms and systems. The competition serves as an important benchmark in noncontact-based fingerprint PAD, offering (a) independent assessment of the state-of-the-art in noncontact-based fingerprint PAD for algorithms and systems, and (b) common evaluation protocol, which includes finger photos of a variety of Presentation Attack Instruments (PAIs) and live fingers to the biometric research community (c) provides standard algorithm and system evaluation protocols, along with the comparative analysis of state-of-the-art algorithms from academia and industry with both old and new android smartphones. The winning algorithm achieved an APCER of 11.35% averaged overall PAIs and a BPCER of 0.62%. The winning system achieved an APCER of 13.0.4%, averaged over all PAIs tested over all the smartphones, and a BPCER of 1.68% over all smartphones tested. Four-finger systems that make individual finger-based PAD decisions were also tested. The dataset used for competition will be available 1 to all researchers as per data share protocol


title: Nonconvex ADMM for Rank-Constrained Matrix Sensing Problem

abstract: Low-rank matrix approximation (LRMA) has been arisen in many applications, such as dynamic MRI, recommendation system and so on. The alternating direction method of multipliers (ADMM) has been designed for the nuclear norm regularized least squares problem and shows a good performance. However, due to the lack of guarantees for the convergence, there are few ADMM algorithms designed directly for the rank-constrained matrix sensing problem (RCMS). Therefore, in this paper, we propose an ADMM-based algorithm for the RCMS. Based on the Kurdyka-Lojasiewicz (KL) property, we prove that the proposed algorithm globally converges. And we discuss a specific case: the rank-constrained matrix completion problem (RCMC). Numerical experiments show that specialized for the matrix completion, the proposed algorithm performs better when the sampling rate is really low in noisy case, which is the key for the matrix completion.


title: The Peculiar Ejecta Rings in the O-Rich Supernova Remnant Puppis A: Evidence of a Binary Interaction?

abstract: Near the center of the Puppis A SNR a series of nested optically emitting rings of high velocity ejecta (known as `the Swirl') were identified several decades ago by Winkler et al. (1989). To date no follow-up observations of these rings have been published, and their physical origin has remained a mystery. We present results of integral field spectroscopy of the Swirl using the Wide Field Integral Spectrograph (\wifes) on the 2.3\,m telescope at Siding Spring Observatory in Australia. The outermost ring exhibits a nitrogen-rich spectrum blueshifted to 1350 km/s, with smaller blueshifted rings within the first exhibiting mostly oxygen-rich spectra moving at 1000 km/s and 750 km/s. The structures are connected by material of intermediate velocity and variable composition, including sulfur-rich material. The Swirl is turbulent and shock excited, and contains as much as 0.5 M$_{\odot}$ of metal-rich material. The chemical composition and exclusively blueshifted radial velocities of the Swirl are consistent with progressively deeper nucleosynthetic layers in a massive progenitor star. We suggest the possibility that the Swirl marks a `funnel' carved into the supernova ejecta by a close, massive binary companion at the moment of explosion.


title: Classification of High-Ordered Topological Nodes towards Moir\'e Flat Bands in Twisted Bilayers

abstract: At magic twisted angles, Dirac cones in twisted bilayer graphene (TBG) can evolve into flat bands, serving as a critical playground for the study of strongly correlated physics. When chiral symmetry is introduced, rigorous mathematical proof confirms that the flat bands are locked at zero energy in the entire Moir\'e Brillouin zone (BZ). Yet, TBG is not the sole platform that exhibits this absolute band flatness. Central to this flatness phenomenon are topological nodes and their specific locations in the BZ. In this study, considering twisted bilayer systems that preserve chiral symmetry, we classify various ordered topological nodes in base layers and all possible node locations across different BZs. Specifically, we constrain the node locations to rotational centers, such as {\Gamma} and M points, to ensure the interlayer coupling retains equal strength in all directions. Using this classification as a foundation, we systematically identify the conditions under which Moir\'e flat bands emerge. Additionally, through the extension of holomorphic functions, we provide proof that flat bands are locked at zero energy, shedding light on the origin of the band flatness. Remarkably, beyond Dirac cones, numerous twisted bilayer nodal platforms can host flat bands with a degeneracy number of more than two, such as four-fold, six-fold, and eight-fold. This multiplicity of degeneracy in flat bands might unveil more complex and enriched correlation physics.


title: Ranks of soft operators in nowhere scattered C*-algebras

abstract: We show that for C*-algebras with the Global Glimm Property, the rank of every operator can be realized as the rank of a soft operator, that is, an element whose hereditary sub-C*-algebra has no nonzero, unital quotients. This implies that the radius of comparison of such a C*-algebra is determined by the soft part of its Cuntz semigroup. Under a mild additional assumption, we show that every Cuntz class dominates a (unique) largest soft Cuntz class. This defines a retract from the Cuntz semigroup onto its soft part, and it follows that the covering dimensions of these semigroups differ by at most $1$.


title: Twin Neural Network Improved k-Nearest Neighbor Regression

abstract: Twin neural network regression is trained to predict differences between regression targets rather than the targets themselves. A solution to the original regression problem can be obtained by ensembling predicted differences between the targets of an unknown data point and multiple known anchor data points. Choosing the anchors to be the nearest neighbors of the unknown data point leads to a neural network-based improvement of k-nearest neighbor regression. This algorithm is shown to outperform both neural networks and k-nearest neighbor regression on small to medium-sized data sets.


title: Balancing Efficiency vs. Effectiveness and Providing Missing Label Robustness in Multi-Label Stream Classification

abstract: Available works addressing multi-label classification in a data stream environment focus on proposing accurate models; however, these models often exhibit inefficiency and cannot balance effectiveness and efficiency. In this work, we propose a neural network-based approach that tackles this issue and is suitable for high-dimensional multi-label classification. Our model uses a selective concept drift adaptation mechanism that makes it suitable for a non-stationary environment. Additionally, we adapt our model to an environment with missing labels using a simple yet effective imputation strategy and demonstrate that it outperforms a vast majority of the state-of-the-art supervised models. To achieve our purposes, we introduce a weighted binary relevance-based approach named ML-BELS using the Broad Ensemble Learning System (BELS) as its base classifier. Instead of a chain of stacked classifiers, our model employs independent weighted ensembles, with the weights generated by the predictions of a BELS classifier. We show that using the weighting strategy on datasets with low label cardinality negatively impacts the accuracy of the model; with this in mind, we use the label cardinality as a trigger for applying the weights. We present an extensive assessment of our model using 11 state-of-the-art baselines, five synthetics, and 13 real-world datasets, all with different characteristics. Our results demonstrate that the proposed approach ML-BELS is successful in balancing effectiveness and efficiency, and is robust to missing labels and concept drift.


title: Quintessence scalar field model in Weyl-type $f(Q,T)$ Gravity with $w_D-w'_D$ analysis

abstract: In the present study, we explore the dynamical characteristics of the quintessence cosmological model in Weyl-type $f(Q,T)$ gravity. Here, $T$ represents the trace of the matter energy-momentum tensor, and $Q$ symbolizes the nonmetricity tensor. We propose a solution to the field equation using the specific parametrization in the form$H(z) = H_{0} (1+z)^{1+\alpha+\beta} e^{\left(\frac{- \beta z}{1+z}\right)}$, which depicts the necessary transition of cosmos from decelerating era to the current accelerating scenario. The values of model parameters are estimated as $H_0 = 71.17\pm 0.25 $, $\alpha = -0.663\pm0.030$, and $\beta = 1.488\pm0.087$ using the MCMC analysis and limiting the model with a joint dataset of Pantheon, BAO, and OHD. We discuss the cosmic behavior of many features of the derived model like EoS parameters, energy density, and cosmic pressure. Further, we have also explored the cosmological behavior of the quintessence model in Weyl $f(Q,T)$gravity. We have described the cosmic behavior of the model by $\omega_D-\omega_D'$ analysis. The diagnosis of the model is also performed using state finders and jerk parameters. In the end, we have discussed the energy conditions for the proposed model. Our analysis shows that the suggested model is well consistent with the recent findings.


title: Hidden Clique Inference in Random Ising Model I: the planted random field Curie-Weiss model

abstract: We study the problem of testing and recovering the hidden $k$-clique Ferromagnetic correlation in the planted Random Field Curie-Weiss model (a.k.a. the pRFCW model). The pRFCW model is a random effect Ising model that exhibits richer phase diagrams both statistically and physically than the standard Curie-Weiss model. Using an alternative characterization of parameter regimes as 'temperatures' and the mean values as 'outer magnetic fields,' we establish the minimax optimal detection rates and recovery rates. The results consist of $7$ distinctive phases for testing and $3$ phases for exact recovery. Our results also imply that the randomness of the outer magnetic field contributes to countable possible convergence rates, which are not observed in the fixed field model. As a byproduct of the proof techniques, we provide two new mathematical results: (1) A family of tail bounds for the average magnetization of the Random Field Curie-Weiss model (a.k.a. the RFCW model) across all temperatures and arbitrary outer fields. (2) A sharp estimate of the information divergence between RFCW models. These play pivotal roles in establishing the major theoretical results in this paper. Additionally, we show that the mathematical structure involved in the pRFCW hidden clique inference problem resembles a 'sparse PCA-like' problem for discrete data. The richer statistical phases than the long-studied Gaussian counterpart shed new light on the theoretical insight of sparse PCA for discrete data.


title: On asymptotics of shifted sums of Dirichlet convolutions

abstract: The objective of this paper is to obtain asymptotic results for shifted sums of multiplicative functions of the form $g \ast 1$, where the function $g$ satisfies the Ramanujan conjecture and has conjectured upper bounds on square moments of its L-function. We establish that for $H$ within the range $X^{1-2\varepsilon} \leq H \leq X^{1-\varepsilon}$, there exist constants $B_{f,h}$ such that $$ \sum_{X\leq n \leq 2X} f(n)f(n+h)-B_{f,h}X=O_{f,\varepsilon}\big(X^{1-\varepsilon/2}\big)$$ for all but $O_{f,\varepsilon}\big(HX^{-1/44+6\varepsilon+o(1)}\big)$ integers $h \in [1,H].$ Additionally, we establish power-saving error terms for almost all integers $h$ in $[1, H]$ when $X^{87/88+7\varepsilon} \leq H \leq X^{1-\varepsilon}$ and apply them to deduce mean-value estimates of long Dirichlet polynomials. Our method is based on the Hardy-Littlewood circle method. In order to treat minor arcs, we use the convolution structure and a cancellation of $g(n)$ that are additively twisted, applying some arguments from a paper of Matom\"a{}ki, Radziwi\l{}\l{} and Tao.


title: Intermediately Trimmed Sums of Oppenheim Expansions: a Strong Law

abstract: The work of this paper is devoted to obtaining strong laws for intermediately trimmed sums of random variables with infinite means. Particularly, we provide conditions under which the intermediately trimmed sums of independent but not identically distributed random variables converge almost surely. Moreover, by dropping the assumption of independence we provide a corresponding convergence result for a special class of Oppenheim expansions. We highlight that the results of this paper generalize the results provided in the recent work of \cite{KS} while the convergence of intermediately trimmed sums of generalized Oppenheim expansions is studied for the first time.


title: A Hierarchical Graph-based Approach for Recognition and Description Generation of Bimanual Actions in Videos

abstract: Nuanced understanding and the generation of detailed descriptive content for (bimanual) manipulation actions in videos is important for disciplines such as robotics, human-computer interaction, and video content analysis. This study describes a novel method, integrating graph based modeling with layered hierarchical attention mechanisms, resulting in higher precision and better comprehensiveness of video descriptions. To achieve this, we encode, first, the spatio-temporal inter dependencies between objects and actions with scene graphs and we combine this, in a second step, with a novel 3-level architecture creating a hierarchical attention mechanism using Graph Attention Networks (GATs). The 3-level GAT architecture allows recognizing local, but also global contextual elements. This way several descriptions with different semantic complexity can be generated in parallel for the same video clip, enhancing the discriminative accuracy of action recognition and action description. The performance of our approach is empirically tested using several 2D and 3D datasets. By comparing our method to the state of the art we consistently obtain better performance concerning accuracy, precision, and contextual relevance when evaluating action recognition as well as description generation. In a large set of ablation experiments we also assess the role of the different components of our model. With our multi-level approach the system obtains different semantic description depths, often observed in descriptions made by different people, too. Furthermore, better insight into bimanual hand-object interactions as achieved by our model may portend advancements in the field of robotics, enabling the emulation of intricate human actions with heightened precision.


title: Tension between HST/JWST and $\Lambda$CDM Cosmology, PBH, and Antimatter in the Galaxy

abstract: Recent data released by James Webb Space Telescope (JWST) and, somewhat earlier, the data presented by Hubble Space Telescope (HST) are commonly understood as a strong indication for breaking of the canonical $\Lambda$CDM cosmology. It is argued in the presented work that massive primordial black holes (PBH) could seed galaxy and quasar formation in the very young universe as it has been conjectured in our paper of 1993 and resolve the tension induced by the JWST and the HST data with the standard cosmology. This point of view is presently supported by several recent works. The proposed mechanism of PBH formation leads to the log-normal mass spectrum of PBHs and predicts abundant antimatter population of our Galaxy, Milky Way. Both these predictions are in excellent agreement with astronomical observations.


title: GeRA: Label-Efficient Geometrically Regularized Alignment

abstract: Pretrained unimodal encoders incorporate rich semantic information into embedding space structures. To be similarly informative, multi-modal encoders typically require massive amounts of paired data for alignment and training. We introduce a semi-supervised Geometrically Regularized Alignment (GeRA) method to align the embedding spaces of pretrained unimodal encoders in a label-efficient way. Our method leverages the manifold geometry of unpaired (unlabeled) data to improve alignment performance. To prevent distortions to local geometry during the alignment process, potentially disrupting semantic neighborhood structures and causing misalignment of unobserved pairs, we introduce a geometric loss term. This term is built upon a diffusion operator that captures the local manifold geometry of the unimodal pretrained encoders. GeRA is modality-agnostic and thus can be used to align pretrained encoders from any data modalities. We provide empirical evidence to the effectiveness of our method in the domains of speech-text and image-text alignment. Our experiments demonstrate significant improvement in alignment quality compared to a variaty of leading baselines, especially with a small amount of paired data, using our proposed geometric regularization.


title: Learning Type Inference for Enhanced Dataflow Analysis

abstract: Statically analyzing dynamically-typed code is a challenging endeavor, as even seemingly trivial tasks such as determining the targets of procedure calls are non-trivial without knowing the types of objects at compile time. Addressing this challenge, gradual typing is increasingly added to dynamically-typed languages, a prominent example being TypeScript that introduces static typing to JavaScript. Gradual typing improves the developer's ability to verify program behavior, contributing to robust, secure and debuggable programs. In practice, however, users only sparsely annotate types directly. At the same time, conventional type inference faces performance-related challenges as program size grows. Statistical techniques based on machine learning offer faster inference, but although recent approaches demonstrate overall improved accuracy, they still perform significantly worse on user-defined types than on the most common built-in types. Limiting their real-world usefulness even more, they rarely integrate with user-facing applications. We propose CodeTIDAL5, a Transformer-based model trained to reliably predict type annotations. For effective result retrieval and re-integration, we extract usage slices from a program's code property graph. Comparing our approach against recent neural type inference systems, our model outperforms the current state-of-the-art by 7.85% on the ManyTypes4TypeScript benchmark, achieving 71.27% accuracy overall. Furthermore, we present JoernTI, an integration of our approach into Joern, an open source static analysis tool, and demonstrate that the analysis benefits from the additional type information. As our model allows for fast inference times even on commodity CPUs, making our system available through Joern leads to high accessibility and facilitates security research.


title: Physical measures on partially hyperbolic diffeomorphisms with multi 1-D centers

abstract: In this paper, we study physical measures for partially hyperbolic diffeomorphisms with multi one-dimensional centers under the condition that all Gibbs $u$-states are hyperbolic. We prove the finiteness of ergodic physical measures. Then by building a criterion for the basin covering property of physical measures, we obtain the basin covering property for ergodic physical measures when there exists some limit measure of empirical measures for Lebesgue almost every point that admits the same sign of Lyapunov exponents on each center.


title: Optimization or Architecture: How to Hack Kalman Filtering

abstract: In non-linear filtering, it is traditional to compare non-linear architectures such as neural networks to the standard linear Kalman Filter (KF). We observe that this mixes the evaluation of two separate components: the non-linear architecture, and the parameters optimization method. In particular, the non-linear model is often optimized, whereas the reference KF model is not. We argue that both should be optimized similarly, and to that end present the Optimized KF (OKF). We demonstrate that the KF may become competitive to neural models - if optimized using OKF. This implies that experimental conclusions of certain previous studies were derived from a flawed process. The advantage of OKF over the standard KF is further studied theoretically and empirically, in a variety of problems. Conveniently, OKF can replace the KF in real-world systems by merely updating the parameters.


title: Crystals and Chern classes

abstract: The goal of this paper is to study the Chern classes of coherent sheaves (and more generally perfect complexes) that admit crystal structures in the setting of crystalline cohomology and more generally relative prismatic cohomology. In the former theory, we show that the Chern classes vanish on the nose; in the latter theory, we show the classes are torsion with uniformly bounded exponents determined by suitable Bernoulli numbers. We also formulate some questions about syntomic Chern classes of such sheaves.


title: A Roadmap towards Intelligent Operations for Reliable Cloud Computing Systems

abstract: The increasing complexity and usage of cloud systems have made it challenging for service providers to ensure reliability. This paper highlights two main challenges, namely internal and external factors, that affect the reliability of cloud microservices. Afterward, we discuss the data-driven approach that can resolve these challenges from four key aspects: ticket management, log management, multimodal analysis, and the microservice resilience testing approach. The experiments conducted show that the proposed data-driven AIOps solution significantly enhances system reliability from multiple angles.


title: A General Offline Reinforcement Learning Framework for Interactive Recommendation

abstract: This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learning framework for recommendation, which enables maximizing cumulative user rewards without online exploration. Specifically, we first introduce a probabilistic generative model for interactive recommendation, and then propose an effective inference algorithm for discrete and stochastic policy learning based on logged feedbacks. In order to perform offline learning more effectively, we propose five approaches to minimize the distribution mismatch between the logging policy and recommendation policy: support constraints, supervised regularization, policy constraints, dual constraints and reward extrapolation. We conduct extensive experiments on two public real-world datasets, demonstrating that the proposed methods can achieve superior performance over existing supervised learning and reinforcement learning methods for recommendation.


title: CebuaNER: A New Baseline Cebuano Named Entity Recognition Model

abstract: Despite being one of the most linguistically diverse groups of countries, computational linguistics and language processing research in Southeast Asia has struggled to match the level of countries from the Global North. Thus, initiatives such as open-sourcing corpora and the development of baseline models for basic language processing tasks are important stepping stones to encourage the growth of research efforts in the field. To answer this call, we introduce CebuaNER, a new baseline model for named entity recognition (NER) in the Cebuano language. Cebuano is the second most-used native language in the Philippines, with over 20 million speakers. To build the model, we collected and annotated over 4,000 news articles, the largest of any work in the language, retrieved from online local Cebuano platforms to train algorithms such as Conditional Random Field and Bidirectional LSTM. Our findings show promising results as a new baseline model, achieving over 70% performance on precision, recall, and F1 across all entity tags, as well as potential efficacy in a crosslingual setup with Tagalog.


title: Magnetic Field Sensitivity of Transition Edge Sensors

abstract: Understanding the magnetic field sensitivity of Transition Edge Sensors (TESs) is vital in optimising the configuration of any magnetic shielding as well as the design of the TESs themselves. An experimental system has been developed to enable the investigation of the applied magnetic field direction on TES behaviour, and the first results from this system are presented. In addition, measurements of the effect of applied magnetic field magnitude on both supercurrent and bias current are presented. The extent to which the current theoretical framework can explain the results is assessed and finally, the impact of this work on the design of TESs and the design of magnetic shielding is discussed.


title: PharmacoNet: Accelerating Large-Scale Virtual Screening by Deep Pharmacophore Modeling

abstract: As the size of accessible compound libraries expands to over 10 billion, the need for more efficient structure-based virtual screening methods is emerging. Different pre-screening methods have been developed for rapid screening, but there is still a lack of structure-based methods applicable to various proteins that perform protein-ligand binding conformation prediction and scoring in an extremely short time. Here, we describe for the first time a deep-learning framework for structure-based pharmacophore modeling to address this challenge. We frame pharmacophore modeling as an instance segmentation problem to determine each protein hotspot and the location of corresponding pharmacophores, and protein-ligand binding pose prediction as a graph-matching problem. PharmacoNet is significantly faster than state-of-the-art structure-based approaches, yet reasonably accurate with a simple scoring function. Furthermore, we show the promising result that PharmacoNet effectively retains hit candidates even under the high pre-screening filtration rates. Overall, our study uncovers the hitherto untapped potential of a pharmacophore modeling approach in deep learning-based drug discovery.


title: On the Hilbert scheme of smooth curves of degree $d=15$ in $\mathbb{P}^5$

abstract: We denote by $\mathcal{H}_{d,g,r}$ the Hilbert scheme of smooth curves, which is the union of components whose general point corresponds to a smooth irreducible and non-degenerate curve of degree $d$ and genus $g$ in $\mathbb{P}^r$. In this article, we study $\mathcal{H}_{15,g,5}$ for every possible genus $g$ and determine their irreducibility. We also study the birationality of the moduli map up to projective equivalence and several key properties such as gonality of a general element as well as characterizing smooth elements of each component.


title: The Active Flux method for the Euler equations on Cartesian grids

abstract: Active Flux is an extension of the Finite Volume method and additionally incorporates point values located at cell boundaries. This gives rise to a globally continuous approximation of the solution. The method is third-order accurate. We demonstrate that a new semi-discrete Active Flux method (first described in Abgrall&Barsukow, 2023 for one space dimension) can easily be used to solve nonlinear hyperbolic systems in multiple dimensions, such as the compressible Euler equations of inviscid hydrodynamics. Originally, the Active Flux method emerged as a fully discrete method, and required an exact or approximate evolution operator for the point value update. For nonlinear problems such an operator is often difficult to obtain, in particular for multiple spatial dimensions. With the new approach it becomes possible to leave behind these difficulties. We introduce a multi-dimensional limiting strategy and demonstrate the performance of the new method on both Riemann problems and subsonic flows.


title: How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?

abstract: Neural Radiance Fields (NeRFs) are gaining significant interest for online active object reconstruction due to their exceptional memory efficiency and requirement for only posed RGB inputs. Previous NeRF-based view planning methods exhibit computational inefficiency since they rely on an iterative paradigm, consisting of (1) retraining the NeRF when new images arrive; and (2) planning a path to the next best view only. To address these limitations, we propose a non-iterative pipeline based on the Prediction of the Required number of Views (PRV). The key idea behind our approach is that the required number of views to reconstruct an object depends on its complexity. Therefore, we design a deep neural network, named PRVNet, to predict the required number of views, allowing us to tailor the data acquisition based on the object complexity and plan a globally shortest path. To train our PRVNet, we generate supervision labels using the ShapeNet dataset. Simulated experiments show that our PRV-based view planning method outperforms baselines, achieving good reconstruction quality while significantly reducing movement cost and planning time. We further justify the generalization ability of our approach in a real-world experiment.


title: Active Implicit Reconstruction Using One-Shot View Planning

abstract: Active object reconstruction using autonomous robots is gaining great interest. A primary goal in this task is to maximize the information of the object to be reconstructed, given limited on-board resources. Previous view planning methods exhibit inefficiency since they rely on an iterative paradigm based on explicit representations, consisting of (1) planning a path to the next-best view only; and (2) requiring a considerable number of less-gain views in terms of surface coverage. To address these limitations, we propose to integrate implicit representations into the One-Shot View Planning (OSVP). The key idea behind our approach is to use implicit representations to obtain the small missing surface areas instead of observing them with extra views. Therefore, we design a deep neural network, named OSVP, to directly predict a set of views given a dense point cloud refined from an initial sparse observation. To train our OSVP network, we generate supervision labels using dense point clouds refined by implicit representations and set covering optimization problems. Simulated experiments show that our method achieves sufficient reconstruction quality, outperforming several baselines under limited view and movement budgets. We further demonstrate the applicability of our approach in a real-world object reconstruction scenario.


title: Landau-level spectrum and the effect of spin-orbit coupling in monolayer graphene on transition metal dichalcogenides

abstract: In graphene on transition metal dichalcogenides, proximity-induced Rashba and spin-valley Zeeman SOCs can coexist that modify graphene's electronic band differently. Here, we show that the Landau levels (LLs) are also affected by these SOCs distinctively enough to estimate their relative strengths from the Landau fan diagram. Using a simple theoretical model, we calculated the LL spectrums of graphene for different SOC strengths, and found that when the total SOC is strong enough (i.e., when it is comparable to the half of the energy gap between the LLs of an intrinsic graphene), the corresponding LLs will split and cross with others depending sensitively on the relative strengths of the SOC terms. To demonstrate how one can use it to estimate the relative SOC strengths, we first identified the four key features that are well separated from the complex background and can be compared with experiment directly, and used them to show that in our sample, the Rashba SOC is stronger than the spin-valley Zeeman SOC that is consistent with other spectroscopic measurements. Our study therefore provides a simple and practical strategy to analyze the LL spectrum in graphene with SOC before carrying out more in-depth measurements.


title: DISCO Might Not Be Funky: Random Intelligent Reflective Surface Configurations That Attack

abstract: Emerging intelligent reflective surfaces (IRSs) significantly improve system performance, but also pose a significant risk for physical layer security (PLS). Unlike the extensive research on legitimate IRS-enhanced communications, in this article we present an adversarial IRS-based fully-passive jammer (FPJ). We describe typical application scenarios for Disco IRS (DIRS)-based FPJ, where an illegitimate IRS with random, time-varying reflection properties acts like a "disco ball" to randomly change the propagation environment. We introduce the principles of DIRS-based FPJ and overview existing investigations of the technology, including a design example employing one-bit phase shifters. The DIRS-based FPJ can be implemented without either jamming power or channel state information (CSI) for the legitimate users (LUs). It does not suffer from the energy constraints of traditional active jammers, nor does it require any knowledge of the LU channels. In addition to the proposed jamming attack, we also propose an anti-jamming strategy that requires only statistical rather than instantaneous CSI. Furthermore, we present a data frame structure that enables the legitimate access point (AP) to estimate the DIRS-jammed channels' statistical characteristics in the presence of the DIRS jamming. Typical cases are discussed to show the impact of the DIRS-based FPJ and the feasibility of the anti-jamming precoder (AJP). Moreover, we outline future research directions and challenges for the DIRS-based FPJ and its anti-jamming precoding to stimulate this line of research and pave the way for practical applications.


title: Efficient Constrained Dynamics Algorithms based on an Equivalent LQR Formulation using Gauss' Principle of Least Constraint

abstract: We derive a family of efficient constrained dynamics algorithms by formulating an equivalent linear quadratic regulator (LQR) problem using Gauss principle of least constraint and solving it using dynamic programming. Our approach builds upon the pioneering (but largely unknown) O(n + m^2d + m^3) solver by Popov and Vereshchagin (PV), where n, m and d are the number of joints, number of constraints and the kinematic tree depth respectively. We provide an expository derivation for the original PV solver and extend it to floating-base kinematic trees with constraints allowed on any link. We make new connections between the LQR's dual Hessian and the inverse operational space inertia matrix (OSIM), permitting efficient OSIM computation, which we further accelerate using matrix inversion lemma. By generalizing the elimination ordering and accounting for MUJOCO-type soft constraints, we derive two original O(n + m) complexity solvers. Our numerical results indicate that significant simulation speed-up can be achieved for high dimensional robots like quadrupeds and humanoids using our algorithms as they scale better than the widely used O(nd^2 + m^2d + d^2m) LTL algorithm of Featherstone. The derivation through the LQR-constrained dynamics connection can make our algorithm accessible to a wider audience and enable cross-fertilization of software and research results between the fields


title: Exchange means change: an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange

abstract: Change detection (CD) is a critical task in studying the dynamics of ecosystems and human activities using multi-temporal remote sensing images. While deep learning has shown promising results in CD tasks, it requires a large number of labeled and paired multi-temporal images to achieve high performance. Pairing and annotating large-scale multi-temporal remote sensing images is both expensive and time-consuming. To make deep learning-based CD techniques more practical and cost-effective, we propose an unsupervised single-temporal CD framework based on intra- and inter-image patch exchange (I3PE). The I3PE framework allows for training deep change detectors on unpaired and unlabeled single-temporal remote sensing images that are readily available in real-world applications. The I3PE framework comprises four steps: 1) intra-image patch exchange method is based on an object-based image analysis method and adaptive clustering algorithm, which generates pseudo-bi-temporal image pairs and corresponding change labels from single-temporal images by exchanging patches within the image; 2) inter-image patch exchange method can generate more types of land-cover changes by exchanging patches between images; 3) a simulation pipeline consisting of several image enhancement methods is proposed to simulate the radiometric difference between pre- and post-event images caused by different imaging conditions in real situations; 4) self-supervised learning based on pseudo-labels is applied to further improve the performance of the change detectors in both unsupervised and semi-supervised cases. Extensive experiments on two large-scale datasets demonstrate that I3PE outperforms representative unsupervised approaches and achieves F1 value improvements of 10.65% and 6.99% to the SOTA method. Moreover, I3PE can improve the performance of the ... (see the original article for full abstract)


title: Invariant curves of low smooth quasi-periodic reversible mappings

abstract: In this paper, we obtain the invariant curves of quasi-periodic reversible mappings with finite smoothness. Since the reversible property is difficult to maintain in the process of approximating smooth functions by analytical ones, R\"{u}ssmann's method in \cite{HR} is invalid. Inspired by the recent work of Li, Qi and Yuan in \cite{LJ}, we turn to regard the reversible mapping as the Poincar\'{e} map of a reversible differential equation. By constructing a KAM theorem for a reversible differential equation which is quasi-periodic in time, we obtain the invariant curves of the reversible mapping. Beyond that, we establish some variants of invariant curve theorems for quasi-periodic reversible mappings.


title: Model Validation of a Low-Speed and Reverse Driving Articulated Vehicle

abstract: For the autonomous operation of articulated vehicles at distribution centers, accurate positioning of the vehicle is of the utmost importance. Automation of these vehicle poses several challenges, e.g. large swept path, asymmetric steering response, large slide slip angles of non-steered trailer axles and trailer instability while reversing. Therefore, a validated vehicle model is required that accurately and efficiently predicts the states of the vehicle. Unlike forward driving, open-loop validation methods can not be used for reverse driving of articulated vehicles due to their unstable dynamics. This paper proposes an approach to stabilize the unstable pole of the system and compares three vehicle models (kinematic, non-linear single track and multibody dynamics model) against real-world test data obtained from low-speed experiments at a distribution center. It is concluded that single track non-linear model has a better performance in comparison to other models for large articulation angles and reverse driving maneuvers.


title: A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent

abstract: In this paper, we provide a theoretical study of noise geometry for minibatch stochastic gradient descent (SGD), a phenomenon where noise aligns favorably with the geometry of local landscape. We propose two metrics, derived from analyzing how noise influences the loss and subspace projection dynamics, to quantify the alignment strength. We show that for (over-parameterized) linear models and two-layer nonlinear networks, when measured by these metrics, the alignment can be provably guaranteed under conditions independent of the degree of over-parameterization. To showcase the utility of our noise geometry characterizations, we present a refined analysis of the mechanism by which SGD escapes from sharp minima. We reveal that unlike gradient descent (GD), which escapes along the sharpest directions, SGD tends to escape from flatter directions and cyclical learning rates can exploit this SGD characteristic to navigate more effectively towards flatter regions. Lastly, extensive experiments are provided to support our theoretical findings.


title: Worst-Case Misidentification Control in Sequential Change Diagnosis using the min-CuSum

abstract: The problem of sequential change diagnosis is considered, where a sequence of independent random elements is accessed sequentially, there is an abrupt change in its distribution at some unknown time, and there are two main operational goals: to quickly detect the change and, upon stopping, to accurately identify the post-change distribution among a finite set of alternatives. The algorithm that raises an alarm as soon as the CuSum statistic that corresponds to one of the post-change alternatives exceeds a certain threshold is studied. When the data are generated over independent channels and the change can occur in only one of them, its worst-case with respect to the change point conditional probability of misidentification, given that there was not a false alarm, is shown to decay exponentially fast in the threshold. As a corollary, in this setup, this algorithm is shown to asymptotically minimize Lorden's detection delay criterion, simultaneously for every possible post-change distribution, within the class of schemes that satisfy prescribed bounds on the false alarm rate and the worst-case conditional probability of misidentification, as the former goes to zero sufficiently faster than the latter. Finally, these theoretical results are also illustrated in simulation studies.


title: Quantum electrodynamical density functional theory for generalized Dicke model

abstract: We formulate and analyze in detail the ground state quantum electrodynamical density functional theory (QEDFT) for a generalized Dicke model describing a collection of $N$ tight-binding dimers minimally coupled to a cavity photon mode. This model is aimed at capturing essential physics of molecules in quantum cavities in polaritonic chemistry, or quantum emitters embedded in mesoscopic resonators of the circuit QED, and, because of its simplicity, is expected to provide important insights regarding the general QEDFT. We adopt the adiabatic connection formalism and the diagrammatic many-body theory to regularly derive a sequence of explicit approximations for the exchange-correlation (xc) energy in the ground state QEDFT, and to compare their performance with the results of exact numerical diagonalization. Specifically, we analyze the earlier proposed one-photon optimized effective potential (OEP) scheme, its direct second order extensions, and a non-perturbative xc functional based on the photon random phase approximation (RPA). Our results demonstrate the excellent performance of RPA-QEDFT in the ultrastrong coupling regime, and for any number $N$ of Dicke molecules in the cavity. We study in detail the scaling of xc energy with $N$, and emphasize the importance for the ground state QEDFT of collective effects in the interaction of molecules with cavity photons. Finally, we discuss implications of our results for realistic systems.


title: New monotonicity and infinite divisibility properties for the Mittag-Leffler function and for the stable distributions

abstract: Hyperbolic complete monotonicity property ($\mathrm{HCM}$) is a way to check if a distribution is a generalized gamma ($\mathrm{GGC}$), hence is infinitely divisible. In this work, we illustrate to which extent the Mittag-Leffler functions $E_\alpha, \;\alpha \in (0,2]$, enjoy the $\mathrm{HCM}$ property, and then intervene deeply in the probabilistic context. We prove that, for suitable $\alpha$ and complex numbers $z$, the real and imaginary part of the functions $x\mapsto E_\alpha \big(z x\big)$, are tightly linked to the stable distributions and to the generalized Cauchy kernel.


title: Do the Benefits of Joint Models for Relation Extraction Extend to Document-level Tasks?

abstract: Two distinct approaches have been proposed for relational triple extraction - pipeline and joint. Joint models, which capture interactions across triples, are the more recent development, and have been shown to outperform pipeline models for sentence-level extraction tasks. Document-level extraction is a more challenging setting where interactions across triples can be long-range, and individual triples can also span across sentences. Joint models have not been applied for document-level tasks so far. In this paper, we benchmark state-of-the-art pipeline and joint extraction models on sentence-level as well as document-level datasets. Our experiments show that while joint models outperform pipeline models significantly for sentence-level extraction, their performance drops sharply below that of pipeline models for the document-level dataset.


title: Learning How to Propagate Messages in Graph Neural Networks

abstract: This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the propagation strategy. For instance, the choices of propagation steps are often specialized to a single graph and are not personalized to different nodes. To compensate for this, in this paper, we present learning to propagate, a general learning framework that not only learns the GNN parameters for prediction but more importantly, can explicitly learn the interpretable and personalized propagate strategies for different nodes and various types of graphs. We introduce the optimal propagation steps as latent variables to help find the maximum-likelihood estimation of the GNN parameters in a variational Expectation-Maximization (VEM) framework. Extensive experiments on various types of graph benchmarks demonstrate that our proposed framework can significantly achieve better performance compared with the state-of-the-art methods, and can effectively learn personalized and interpretable propagate strategies of messages in GNNs.


title: Comics for Everyone: Generating Accessible Text Descriptions for Comic Strips

abstract: Comic strips are a popular and expressive form of visual storytelling that can convey humor, emotion, and information. However, they are inaccessible to the BLV (Blind or Low Vision) community, who cannot perceive the images, layouts, and text of comics. Our goal in this paper is to create natural language descriptions of comic strips that are accessible to the visually impaired community. Our method consists of two steps: first, we use computer vision techniques to extract information about the panels, characters, and text of the comic images; second, we use this information as additional context to prompt a multimodal large language model (MLLM) to produce the descriptions. We test our method on a collection of comics that have been annotated by human experts and measure its performance using both quantitative and qualitative metrics. The outcomes of our experiments are encouraging and promising.


title: Pianist Identification Using Convolutional Neural Networks

abstract: This paper presents a comprehensive study of automatic performer identification in expressive piano performances using convolutional neural networks (CNNs) and expressive features. Our work addresses the challenging multi-class classification task of identifying virtuoso pianists, which has substantial implications for building dynamic musical instruments with intelligence and smart musical systems. Incorporating recent advancements, we leveraged large-scale expressive piano performance datasets and deep learning techniques. We refined the scores by expanding repetitions and ornaments for more accurate feature extraction. We demonstrated the capability of one-dimensional CNNs for identifying pianists based on expressive features and analyzed the impact of the input sequence lengths and different features. The proposed model outperforms the baseline, achieving 85.3% accuracy in a 6-way identification task. Our refined dataset proved more apt for training a robust pianist identifier, making a substantial contribution to the field of automatic performer identification. Our codes have been released at https://github.com/BetsyTang/PID-CNN.


title: Carleman Estimates for Second Order Elliptic Operators with Limiting Weights, an Elementary Approach

abstract: By using some deep tools from microlocal analysis, the authors of the papers (Ann. of Math., 165 (2007), 567--591, J. Amer. Math. Soc., 23 (2010), 655--691; Invent. Math., 178 (2009), 119--171; Duke Math. J., 158(2011), 83--120) have successfully established various Carleman estimates for elliptic operators that possess limiting Carleman weight. In this study, we revisit these problems and present a unified and fundamental approach for deriving these estimates. The main tool we employ is an elementary pointwise estimate for second-order elliptic operators.


title: On the algebra of derivations of some low-dimensional Leibniz algebras

abstract: We study the algebras of derivations of nilpotent Leibniz algebras of low dimensions.


title: You Do Not Need Additional Priors in Camouflage Object Detection

abstract: Camouflage object detection (COD) poses a significant challenge due to the high resemblance between camouflaged objects and their surroundings. Although current deep learning methods have made significant progress in detecting camouflaged objects, many of them heavily rely on additional prior information. However, acquiring such additional prior information is both expensive and impractical in real-world scenarios. Therefore, there is a need to develop a network for camouflage object detection that does not depend on additional priors. In this paper, we propose a novel adaptive feature aggregation method that effectively combines multi-layer feature information to generate guidance information. In contrast to previous approaches that rely on edge or ranking priors, our method directly leverages information extracted from image features to guide model training. Through extensive experimental results, we demonstrate that our proposed method achieves comparable or superior performance when compared to state-of-the-art approaches.


title: A Comparative Study of Training Objectives for Clarification Facet Generation

abstract: Due to the ambiguity and vagueness of a user query, it is essential to identify the query facets for the clarification of user intents. Existing work on query facet generation has achieved compelling performance by sequentially predicting the next facet given previously generated facets based on pre-trained language generation models such as BART. Given a query, there are mainly two types of training objectives to guide the facet generation models. One is to generate the default sequence of ground-truth facets, and the other is to enumerate all the permutations of ground-truth facets and use the sequence that has the minimum loss for model updates. The second is permutation-invariant while the first is not. In this paper, we aim to conduct a systematic comparative study of various types of training objectives, with different properties of not only whether it is permutation-invariant but also whether it conducts sequential prediction and whether it can control the count of output facets. To this end, we propose another three training objectives of different aforementioned properties. For comprehensive comparisons, besides the commonly used evaluation that measures the matching with ground-truth facets, we also introduce two diversity metrics to measure the diversity of the generated facets. Based on an open-domain query facet dataset, i.e., MIMICS, we conduct extensive analyses and show the pros and cons of each method, which could shed light on model training for clarification facet generation. The code can be found at \url{https://github.com/ShiyuNee/Facet-Generation}


title: UniAudio: An Audio Foundation Model Toward Universal Audio Generation

abstract: Large Language models (LLM) have demonstrated the capability to handle a variety of generative tasks. This paper presents the UniAudio system, which, unlike prior task-specific approaches, leverages LLM techniques to generate multiple types of audio (including speech, sounds, music, and singing) with given input conditions. UniAudio 1) first tokenizes all types of target audio along with other condition modalities, 2) concatenates source-target pair as a single sequence, and 3) performs next-token prediction using LLM. Also, a multi-scale Transformer model is proposed to handle the overly long sequences caused by the residual vector quantization based neural codec in tokenization. Training of UniAudio is scaled up to 165K hours of audio and 1B parameters, based on all generative tasks, aiming to obtain sufficient prior knowledge not only in the intrinsic properties of audio but also the inter-relationship between audio and other modalities. Therefore, the trained UniAudio model has the potential to become a foundation model for universal audio generation: it shows strong capability in all trained tasks and can seamlessly support new audio generation tasks after simple fine-tuning. Experiments demonstrate that UniAudio achieves state-of-the-art or at least competitive results on most of the 11 tasks. Demo and code are released at https://github.com/yangdongchao/UniAudio


title: Concurrent Hyperproperties

abstract: Trace properties, which are sets of execution traces, are often used to analyze systems, but their expressiveness is limited. Clarkson and Schneider defined hyperproperties as a generalization of trace properties to sets of sets of traces. Typical applications of hyperproperties are found in information flow security. We introduce an analogous definition of concurrent hyperproperties, by generalizing traces to concurrent traces, which we define as partially ordered multisets. We take Petri nets as the basic semantic model. Concurrent traces are formalized via causal nets. To check concurrent hyperproperties, we define may and must testing of sets of concurrent traces in the style of DeNicola and Hennessy, using the parallel composition of Petri nets. In our approach, we thus distinguish nondeterministic and concurrent behavior. We discuss examples where concurrent hyperproperties are needed.


title: Evaluating Speech Synthesis by Training Recognizers on Synthetic Speech

abstract: Modern speech synthesis systems have improved significantly, with synthetic speech being indistinguishable from real speech. However, efficient and holistic evaluation of synthetic speech still remains a significant challenge. Human evaluation using Mean Opinion Score (MOS) is ideal, but inefficient due to high costs. Therefore, researchers have developed auxiliary automatic metrics like Word Error Rate (WER) to measure intelligibility. Prior works focus on evaluating synthetic speech based on pre-trained speech recognition models, however, this can be limiting since this approach primarily measures speech intelligibility. In this paper, we propose an evaluation technique involving the training of an ASR model on synthetic speech and assessing its performance on real speech. Our main assumption is that by training the ASR model on the synthetic speech, the WER on real speech reflects the similarity between distributions, a broader assessment of synthetic speech quality beyond intelligibility. Our proposed metric demonstrates a strong correlation with both MOS naturalness and MOS intelligibility when compared to SpeechLMScore and MOSNet on three recent Text-to-Speech (TTS) systems: MQTTS, StyleTTS, and YourTTS.


title: The all-time maximum for branching Brownian motion with absorption conditioned on long-time survival

abstract: We consider branching Brownian motion in which initially there is one particle at $x$, particles produce a random number of offspring with mean $m+1$ at the time of branching events, and each particle branches at rate $\beta = 1/2m$. Particles independently move according to Brownian motion with drift $-1$ and are killed at the origin. It is well-known that this process eventually dies out with positive probability. We condition this process to survive for an unusually large time $t$ and study the behavior of the process at small times $s \ll t$ using a spine decomposition. We show, in particular, that the time when a particle gets furthest from the origin is of the order $t^{5/6}$.


title: A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigm

abstract: Meta learning is a promising paradigm to enable skill transfer across tasks. Most previous methods employ the empirical risk minimization principle in optimization. However, the resulting worst fast adaptation to a subset of tasks can be catastrophic in risk-sensitive scenarios. To robustify fast adaptation, this paper optimizes meta learning pipelines from a distributionally robust perspective and meta trains models with the measure of expected tail risk. We take the two-stage strategy as heuristics to solve the robust meta learning problem, controlling the worst fast adaptation cases at a certain probabilistic level. Experimental results show that our simple method can improve the robustness of meta learning to task distributions and reduce the conditional expectation of the worst fast adaptation risk.


title: Real-Time Risk Analysis with Optimization Proxies

abstract: The increasing penetration of renewable generation and distributed energy resources requires new operating practices for power systems, wherein risk is explicitly quantified and managed. However, traditional risk-assessment frameworks are not fast enough for real-time operations, because they require numerous simulations, each of which requires solving multiple economic dispatch problems sequentially. The paper addresses this computational challenge by proposing proxy-based risk assessment, wherein optimization proxies are trained to learn the input-to-output mapping of an economic dispatch optimization solver. Once trained, the proxies make predictions in milliseconds, thereby enabling real-time risk assessment. The paper leverages self-supervised learning and end-to-end-feasible architecture to achieve high-quality sequential predictions. Numerical experiments on large systems demonstrate the scalability and accuracy of the proposed approach.


title: How well does LLM generate security tests?

abstract: Developers often build software on top of third-party libraries (Libs) to improve programmer productivity and software quality. The libraries may contain vulnerabilities exploitable by hackers to attack the applications (Apps) built on top of them. People refer to such attacks as supply chain attacks, the documented number of which has increased 742% in 2022. People created tools to mitigate such attacks, by scanning the library dependencies of Apps, identifying the usage of vulnerable library versions, and suggesting secure alternatives to vulnerable dependencies. However, recent studies show that many developers do not trust the reports by these tools; they ask for code or evidence to demonstrate how library vulnerabilities lead to security exploits, in order to assess vulnerability severity and modification necessity. Unfortunately, manually crafting demos of application-specific attacks is challenging and time-consuming, and there is insufficient tool support to automate that procedure. In this study, we used ChatGPT-4.0 to generate security tests, and to demonstrate how vulnerable library dependencies facilitate the supply chain attacks to given Apps. We explored various prompt styles/templates, and found that ChatGPT-4.0 generated tests for all 55 Apps, demonstrating 24 attacks successfully. It outperformed two state-of-the-art security test generators -- TRANSFER and SIEGE -- by generating a lot more tests and achieving more exploits. ChatGPT-4.0 worked better when prompts described more on the vulnerabilities, possible exploits, and code context. Our research will shed light on new research in security test generation. The generated tests will help developers create secure by design and secure by default software.


title: Automatic Data Repair: Are We Ready to Deploy?

abstract: Data quality is paramount in today's data-driven world, especially in the era of generative AI. Dirty data with errors and inconsistencies usually leads to flawed insights, unreliable decision-making, and biased or low-quality outputs from generative models. The study of repairing erroneous data has gained significant importance. Existing data repair algorithms differ in information utilization, problem settings, and are tested in limited scenarios. In this paper, we initially compare and summarize these algorithms using a new guided information-based taxonomy. We then systematically conduct a comprehensive evaluation of 12 mainstream data repair algorithms under the settings of various data error rates, error types, and downstream analysis tasks, assessing their error reduction performance with a novel metric. Also, we develop an effective and unified repair optimization strategy that substantially benefits the state of the arts, as empirically confirmed. We demonstrate that, the pure clean data may not necessarily yield the best performance in data analysis tasks and data is always worth repairing regardless of error rate. Based on the found observations and insights, we provide some practical guidelines for 5 scenarios and 2 main data analysis tasks. We anticipate this paper enabling researchers and users to well understand and deploy data repair algorithms in practice. Finally, we outline research challenges and promising future directions in the data repair field.


title: Logical Bias Learning for Object Relation Prediction

abstract: Scene graph generation (SGG) aims to automatically map an image into a semantic structural graph for better scene understanding. It has attracted significant attention for its ability to provide object and relation information, enabling graph reasoning for downstream tasks. However, it faces severe limitations in practice due to the biased data and training method. In this paper, we present a more rational and effective strategy based on causal inference for object relation prediction. To further evaluate the superiority of our strategy, we propose an object enhancement module to conduct ablation studies. Experimental results on the Visual Gnome 150 (VG-150) dataset demonstrate the effectiveness of our proposed method. These contributions can provide great potential for foundation models for decision-making.


title: Safety-Critical Control of Nonholonomic Vehicles in Dynamic Environments using Velocity Obstacles

abstract: This paper considers collision avoidance for vehicles with first-order nonholonomic constraints maintaining nonzero forward speeds, moving within dynamic environments. We leverage the concept of control barrier functions (CBFs) to synthesize control inputs that prioritize safety, where the safety criteria are derived from the velocity obstacle principle. Existing instantiations of CBFs for collision avoidance, e.g., based on maintaining a minimal distance, can result in control inputs that make the vehicle stop or even reverse. The proposed formulation effectively separates speed control from steering, allowing the vehicle to maintain a forward motion without compromising safety. This is beneficial for ensuring that the vehicle advances towards its desired destination, and it is moreover an underlying requirement for certain vehicles such as marine vessels and fixed-wing UAVs. Theoretical safety guarantees are provided, and numerical simulations demonstrate the efficiency of the strategy in environments containing moving obstacles.


title: Generalized models for black-bounce solutions in $f(R)$ Gravity

abstract: In this article, the implementation of black-bounce solutions in $f(R)$ theories is investigated. Black-bounce solutions are regular configurations of the static spherically symmetric space-time, containing both black holes and wormholes structures. In General Relativity (GR), black-bounce solution implies violation of the energy conditions. We investigate the same issue in $f(R)$ theories using two strategies: first, supposing a given form for the $f(R)$ function and then determining the matter behavior; second, imposing a condition on the matter density and obtaining the resulting $f(R)$ function. In all cases, a given structure for the metric functions is supposed. Violation of the energy conditions still occur but they are less severe than in the corresponding GR cases. We propose a zero-density model that has horizons, which differs from the GR case. We also propose a model with positive energy density and show that $\rho+p_r>0$, which was not the case in GR.


title: Efficient MPC for Emergency Evasive Maneuvers, Part I: Hybridization of the Nonlinear Problem

abstract: Despite the extensive application of nonlinear Model Predictive Control (MPC) in automated driving, balancing its computational efficiency with respect to the control performance and constraint satisfaction remains a challenge in emergency scenarios: in such situations, sub-optimal but computationally fast responses are more valuable than optimal responses obtained after long computations. In this paper, we introduce a hybridization approach for efficient approximation of nonlinear vehicle dynamics and non-convex constraints using a hybrid systems modeling framework. Hybridization allows to reformulate the nonlinear MPC problem during emergency evasive maneuvers as a hybrid MPC problem. In this regard, Max-Min-Plus-Scaling (MMPS) hybrid modeling is used to approximate the nonlinear vehicle dynamics. Meanwhile, different formulations for constraint approximation are presented, and various grid-generation methods are compared to solve these approximation problems. Among these, two novel grid types are introduced to structurally include the influence of the system dynamics on the grid point distributions in the state domain. Overall, the work presents and compares three hybrid models and four hybrid constraints for efficient MPC synthesis and offers guidelines for implementation of the presented hybridization framework in other applications.


title: Efficient MPC for Emergency Evasive Maneuvers, Part II: Comparative Assessment for Hybrid Control

abstract: Optimization-based approaches such as Model Predictive Control (MPC) are promising approaches in proactive control for safety-critical applications with changing environments such as automated driving systems. However, the computational complexity of the MPC optimization problem coupled with the need for real-time control in hazardous scenarios is the main bottleneck in realization of automation levels four and five for driving systems. In this paper, we construct hybrid formulations of the nonlinear MPC problem for tracking control during emergency evasive maneuvers and assess their computational efficiency in terms of accuracy and solution time. To hybridize the MPC problem, we combine three hybrid approximations of the prediction model and four approximations of the nonlinear stability and tire saturation constraints and simulate the closed-loop behavior of the resulting controllers during five emergency maneuvers for different prediction horizons. Further, we compare the robustness of the controllers in the presence of friction uncertainty as well to assess the accuracy-time trade-off in cases where the friction of the road is either unknown or has an offset error with respect to the prediction model. This robustness is studied for different levels of friction uncertainty, as well as investigated with respect to the proximity to the vehicle handling limits. We show that the hybridization of the MPC problem is an efficient approach for real-time implementation of MPC during emergency evasive maneuvers, paving the way for implementation of high levels of automation.


title: Exact Entanglement Propagation Dynamics in Integrable Heisenberg Chains

abstract: The exact single-magnon entanglement evolution in Heisenberg chains is obtained using the Quantum Correlation Transfer Function (QCTF) formulation. The individual spins' entanglement is given by a hypergeometric function, and its transient behavior is described via a Bessel function of the first kind. The presented characterization through the lens of QCTF allowed for calculating the ballistic single-magnon entanglement edge velocity in Heisenberg chains, which has not been achieved before. Our results can be extended to the multi-magnon regime, therefore opening up the means to explain equilibration dynamics and thermodynamics in Heisenberg chains.


title: Analyzing Quantum Programs with LintQ: A Static Analysis Framework for Qiskit

abstract: As quantum computing is rising in popularity, the amount of quantum programs and the number of developers writing them are increasing rapidly. Unfortunately, writing correct quantum programs is challenging due to various subtle rules developers need to be aware of. Empirical studies show that 40-82% of all bugs in quantum software are specific to the quantum domain. Yet, existing static bug detection frameworks are mostly unaware of quantum-specific concepts, such as circuits, gates, and qubits, and hence miss many bugs. This paper presents LintQ, a comprehensive static analysis framework for detecting bugs in quantum programs. Our approach is enabled by a set of abstractions designed to reason about common concepts in quantum computing without referring to the details of the underlying quantum computing platform. Built on top of these abstractions, LintQ offers an extensible set of ten analyses that detect likely bugs, such as operating on corrupted quantum states, redundant measurements, and incorrect compositions of sub-circuits. We apply the approach to a newly collected dataset of 7,568 real-world Qiskit-based quantum programs, showing that LintQ effectively identifies various programming problems, with a precision of 91.0% in its default configuration with the six best performing analyses. Comparing to a general-purpose linter and two existing quantum-aware techniques shows that almost all problems (92.1%) found by LintQ during our evaluation are missed by prior work. LintQ hence takes an important step toward reliable software in the growing field of quantum computing.


title: Bayesian test of Brans-Dicke theories with planetary ephemerides: Investigating the strong equivalence principle

abstract: Context: We are testing the Brans-Dicke class of scalar tensor theories with planetary ephemerides. Aims: In this work, we apply our recently proposed Bayesian methodology to the Brans-Dicke case, with an emphasis on the issue of the strong equivalence principle (SEP). Methods: We use an MCMC approach coupled to full consistent planetary ephemeris construction (from point-mass body integration to observational fit) and compare the posterior distributions obtained with and without the introduction of potential violations of the SEP. Results: We observe a shift in the confidence levels of the posteriors obtained. We interpret this shift as marginal evidence suggesting that the effect of violation of the SEP can no longer be assumed to be negligible in planetary ephemerides with the current data. We also notably report that the constraint on the Brans-Dicke parameter with planetary ephemerides is getting closer to the figure reported from the Cassini spacecraft alone, but also to the constraints from pulsars. We anticipate that data from future spacecraft missions, such as BepiColombo, will significantly enhance the constraints based on planetary ephemerides.


title: First measurement of $\Lambda N$ inelastic scattering with $\Lambda$ from $e^{+} e^{-} \rightarrow J/\psi \to \Lambda \bar{\Lambda}$

abstract: Using an $e^+ e^-$ collision data sample of $(10087 \pm 44)\times10^6 ~J/\psi$ events taken at the center-of-mass energy of $3.097~\rm{GeV}$ by the BESIII detector at the BEPCII collider, the process $\Lambda+N \rightarrow \Sigma^+ + X$ is studied for the first time employing a novel method. The $\Sigma^{+}$ hyperons are produced by the collisions of $\Lambda$ hyperons from $J/\psi$ decays with nuclei in the material of the BESIII detector. The total cross section of $\Lambda + ^{9}{\rm Be} \rightarrow \Sigma^+ + X$ is measured to be $\sigma = (37.3 \pm 4.7 \pm 3.5)~{\rm mb}$ at $\Lambda$ beam momenta within $[1.057, 1.091]~{\rm GeV}/c$, where the uncertainties are statistical and systematic, respectively. This analysis is the first study of $\Lambda$-nucleon interactions at an $e^+ e^-$ collider, providing information and constraints relevant for the strong-interaction potential, the origin of color confinement, the unified model for baryon-baryon interactions, and the internal structure of neutron stars.


title: Fermionic vs. bosonic thermalization in the phonon-driven exciton dynamics: An analytic dimensionality study

abstract: Excitons are compound particles formed from an electron and a hole in semiconductors. The impact of this substructure on the phonon-exciton interaction is described by a closed system of microscopic scattering equations. To calculate the actual excitonic thermalization properties beyond the pure bosonic picture, this equation is derived directly from an electron-hole picture within the Heisenberg equation of motion framework. In addition to the well-known bosonic character of the compound particles, we identified processes of a repulsive, fermionic type, as well as attractive carrier exchange contributing to the scattering process. In this analytical study we give general statements about the thermalization of excitons in two and three dimensional semiconductors. We give insights on the strong dependence of the thermalization characteristics of the exciton Bohr radius and the thermalization wavelength. Above all, we analytically provide arguments why a bosonic behavior of excitons - such as an enhanced ground state occupation - requires the dominant phonon scattering to be quasielastic. Acoustic phonons tend to fulfil this, as each scattering event only takes small amounts of energy out of the distribution, while optical phonons tend to prevent macroscopic occupations of the lowest exciton state, since the Pauli repulsion between the individual carriers will then dominate the thermalization dynamics.


title: Design Challenges for a Future Liquid Xenon Observatory

abstract: An ultimate liquid xenon experiment would be limited in its dark matter science reach by irreducible neutrino backgrounds, which are an exciting signal in their own right. To achieve such sensitivity, other backgrounds that currently plague these detectors must be better mitigated, and extreme care must be taken in the design and construction phases. A 100-tonne xenon target is compelling to search for weakly interacting massive particle dark matter, and has capabilities to study coherent elastic neutrino-nucleus scattering and search for neutrinoless double-beta decay signatures. Historically, liquid xenon time projection chambers have scaled to larger target masses with great success. This paper gives an overview of challenges that need to be met for the next generation of detector to obtain a kilotonne$\times$year exposure. Such tasks include the procurement and purification of xenon, radiopure and reliable detector components, sensitive outer detector vetoes, powerful data handling and analyses, and an ability to operate stably for timescales of over a decade.


title: HOH: Markerless Multimodal Human-Object-Human Handover Dataset with Large Object Count

abstract: We present the HOH (Human-Object-Human) Handover Dataset, a large object count dataset with 136 objects, to accelerate data-driven research on handover studies, human-robot handover implementation, and artificial intelligence (AI) on handover parameter estimation from 2D and 3D data of person interactions. HOH contains multi-view RGB and depth data, skeletons, fused point clouds, grasp type and handedness labels, object, giver hand, and receiver hand 2D and 3D segmentations, giver and receiver comfort ratings, and paired object metadata and aligned 3D models for 2,720 handover interactions spanning 136 objects and 20 giver-receiver pairs-40 with role-reversal-organized from 40 participants. We also show experimental results of neural networks trained using HOH to perform grasp, orientation, and trajectory prediction. As the only fully markerless handover capture dataset, HOH represents natural human-human handover interactions, overcoming challenges with markered datasets that require specific suiting for body tracking, and lack high-resolution hand tracking. To date, HOH is the largest handover dataset in number of objects, participants, pairs with role reversal accounted for, and total interactions captured.


title: Subtractive Mixture Models via Squaring: Representation and Learning

abstract: Mixture models are traditionally represented and learned by adding several distributions as components. Allowing mixtures to subtract probability mass or density can drastically reduce the number of components needed to model complex distributions. However, learning such subtractive mixtures while ensuring they still encode a non-negative function is challenging. We investigate how to learn and perform inference on deep subtractive mixtures by squaring them. We do this in the framework of probabilistic circuits, which enable us to represent tensorized mixtures and generalize several other subtractive models. We theoretically prove that the class of squared circuits allowing subtractions can be exponentially more expressive than traditional additive mixtures; and, we empirically show this increased expressiveness on a series of real-world distribution estimation tasks.


title: Averaging Property of Wedge Product and Naturality in Discrete Exterior Calculus

abstract: In exterior calculus on smooth manifolds, the exterior derivative and wedge product are natural with respect to smooth maps between manifolds, that is, these operations commute with pullback. In discrete exterior calculus (DEC), simplicial cochains play the role of discrete forms, the coboundary operator serves as the discrete exterior derivative, and the antisymmetrized cup product provides a discrete wedge product. We show that these discrete operations in DEC are natural with respect to abstract simplicial maps. A second contribution is a new averaging interpretation of the discrete wedge product in DEC. We also show that this wedge product is the same as Wilson's cochain product defined using Whitney and de Rham maps.


title: Improving Length-Generalization in Transformers via Task Hinting

abstract: It has been observed in recent years that transformers have problems with length generalization for certain types of reasoning and arithmetic tasks. In particular, the performance of a transformer model trained on tasks (say addition) up to a certain length (e.g., 5 digit numbers) drops sharply when applied to longer instances of the same problem. This work proposes an approach based on task hinting towards addressing length generalization. Our key idea is that while training the model on task-specific data, it is helpful to simultaneously train the model to solve a simpler but related auxiliary task as well. We study the classical sorting problem as a canonical example to evaluate our approach. We design a multitask training framework and show that task hinting significantly improve length generalization. For sorting we show that it is possible to train models on data consisting of sequences having length at most $20$, and improve the test accuracy on sequences of length $100$ from less than 1% (for standard training) to more than 92% (via task hinting). Our study uncovers several interesting aspects of length generalization. We observe that while several auxiliary tasks may seem natural a priori, their effectiveness in improving length generalization differs dramatically. We further use probing and visualization-based techniques to understand the internal mechanisms via which the model performs the task, and propose a theoretical construction consistent with the observed learning behaviors of the model. Based on our construction, we show that introducing a small number of length dependent parameters into the training procedure can further boost the performance on unseen lengths. Finally, we also show the efficacy of our task hinting based approach beyond sorting, giving hope that these techniques will be applicable in broader contexts.


title: Review of deep learning in healthcare

abstract: Given the growing complexity of healthcare data over the last several years, using machine learning techniques like Deep Neural Network (DNN) models has gained increased appeal. In order to extract hidden patterns and other valuable information from the huge quantity of health data, which traditional analytics are unable to do in a reasonable length of time, machine learning (ML) techniques are used. Deep Learning (DL) algorithms in particular have been shown as potential approaches to pattern identification in healthcare systems. This thought has led to the contribution of this research, which examines deep learning methods used in healthcare systems via an examination of cutting-edge network designs, applications, and market trends. To connect deep learning methodologies and human healthcare interpretability, the initial objective is to provide in-depth insight into the deployment of deep learning models in healthcare solutions. And last, to outline the current unresolved issues and potential directions.


title: Physics-Informed Graph Neural Network for Dynamic Reconfiguration of Power Systems

abstract: To maintain a reliable grid we need fast decision-making algorithms for complex problems like Dynamic Reconfiguration (DyR). DyR optimizes distribution grid switch settings in real-time to minimize grid losses and dispatches resources to supply loads with available generation. DyR is a mixed-integer problem and can be computationally intractable to solve for large grids and at fast timescales. We propose GraPhyR, a Physics-Informed Graph Neural Network (GNNs) framework tailored for DyR. We incorporate essential operational and connectivity constraints directly within the GNN framework and train it end-to-end. Our results show that GraPhyR is able to learn to optimize the DyR task.


title: Spectral Neural Networks: Approximation Theory and Optimization Landscape

abstract: There is a large variety of machine learning methodologies that are based on the extraction of spectral geometric information from data. However, the implementations of many of these methods often depend on traditional eigensolvers, which present limitations when applied in practical online big data scenarios. To address some of these challenges, researchers have proposed different strategies for training neural networks as alternatives to traditional eigensolvers, with one such approach known as Spectral Neural Network (SNN). In this paper, we investigate key theoretical aspects of SNN. First, we present quantitative insights into the tradeoff between the number of neurons and the amount of spectral geometric information a neural network learns. Second, we initiate a theoretical exploration of the optimization landscape of SNN's objective to shed light on the training dynamics of SNN. Unlike typical studies of convergence to global solutions of NN training dynamics, SNN presents an additional complexity due to its non-convex ambient loss function.