title: KD-FixMatch: Knowledge Distillation Siamese Neural Networks

abstract: Semi-supervised learning (SSL) has become a crucial approach in deep learning as a way to address the challenge of limited labeled data. The success of deep neural networks heavily relies on the availability of large-scale high-quality labeled data. However, the process of data labeling is time-consuming and unscalable, leading to shortages in labeled data. SSL aims to tackle this problem by leveraging additional unlabeled data in the training process. One of the popular SSL algorithms, FixMatch, trains identical weight-sharing teacher and student networks simultaneously using a siamese neural network (SNN). However, it is prone to performance degradation when the pseudo labels are heavily noisy in the early training stage. We present KD-FixMatch, a novel SSL algorithm that addresses the limitations of FixMatch by incorporating knowledge distillation. The algorithm utilizes a combination of sequential and simultaneous training of SNNs to enhance performance and reduce performance degradation. Firstly, an outer SNN is trained using labeled and unlabeled data. After that, the network of the well-trained outer SNN generates pseudo labels for the unlabeled data, from which a subset of unlabeled data with trusted pseudo labels is then carefully created through high-confidence sampling and deep embedding clustering. Finally, an inner SNN is trained with the labeled data, the unlabeled data, and the subset of unlabeled data with trusted pseudo labels. Experiments on four public data sets demonstrate that KD-FixMatch outperforms FixMatch in all cases. Our results indicate that KD-FixMatch has a better training starting point that leads to improved model performance compared to FixMatch.


title: Digraph Branchings and Matrix Determinants

abstract: We present a version of the matrix-tree theorem, which relates the determinant of a matrix to sums of weights of arborescences of its directed graph representation. Our treatment allows for non-zero column sums in the parent matrix by adding a root vertex to the usually considered matrix directed graph. We use our result to prove a version of the matrix-forest, or all-minors, theorem, which relates minors of the matrix to forests of arborescences of the matrix digraph. We then show that it is possible, when the source and target vertices of an arc are not strongly connected, to move the source of the arc in the matrix directed graph and leave the resulting matrix determinant unchanged, as long as the source and target vertices are not strongly connected after the move. This result enables graphical strategies for factoring matrix determinants.


title: Exploring Geometric Deep Learning For Precipitation Nowcasting

abstract: Precipitation nowcasting (up to a few hours) remains a challenge due to the highly complex local interactions that need to be captured accurately. Convolutional Neural Networks rely on convolutional kernels convolving with grid data and the extracted features are trapped by limited receptive field, typically expressed in excessively smooth output compared to ground truth. Thus they lack the capacity to model complex spatial relationships among the grids. Geometric deep learning aims to generalize neural network models to non-Euclidean domains. Such models are more flexible in defining nodes and edges and can effectively capture dynamic spatial relationship among geographical grids. Motivated by this, we explore a geometric deep learning-based temporal Graph Convolutional Network (GCN) for precipitation nowcasting. The adjacency matrix that simulates the interactions among grid cells is learned automatically by minimizing the L1 loss between prediction and ground truth pixel value during the training procedure. Then, the spatial relationship is refined by GCN layers while the temporal information is extracted by 1D convolution with various kernel lengths. The neighboring information is fed as auxiliary input layers to improve the final result. We test the model on sequences of radar reflectivity maps over the Trento/Italy area. The results show that GCNs improves the effectiveness of modeling the local details of the cloud profile as well as the prediction accuracy by achieving decreased error measures.


title: Mobile Vision Transformer-based Visual Object Tracking

abstract: The introduction of robust backbones, such as Vision Transformers, has improved the performance of object tracking algorithms in recent years. However, these state-of-the-art trackers are computationally expensive since they have a large number of model parameters and rely on specialized hardware (e.g., GPU) for faster inference. On the other hand, recent lightweight trackers are fast but are less accurate, especially on large-scale datasets. We propose a lightweight, accurate, and fast tracking algorithm using Mobile Vision Transformers (MobileViT) as the backbone for the first time. We also present a novel approach of fusing the template and search region representations in the MobileViT backbone, thereby generating superior feature encoding for target localization. The experimental results show that our MobileViT-based Tracker, MVT, surpasses the performance of recent lightweight trackers on the large-scale datasets GOT10k and TrackingNet, and with a high inference speed. In addition, our method outperforms the popular DiMP-50 tracker despite having 4.7 times fewer model parameters and running at 2.8 times its speed on a GPU. The tracker code and models are available at https://github.com/goutamyg/MVT


title: Photodetachment dynamics using nonlocal dicrete-state-in-continuum model

abstract: In this preprint I propose that the non local discrete-state-in-continuum model previously successfully used to describe the inelastic electron molecule collisions can also be used to model the electron photo-detachment from the molecular anions. The basic theory is sketched and the approach is tested on the model of electron photodetachment from diatomic molecular anion.


title: Studying Accuracy of Machine Learning Models Trained on Lab Lifting Data in Solving Real-World Problems Using Wearable Sensors for Workplace Safety

abstract: Porting ML models trained on lab data to real-world situations has long been a challenge. This paper discusses porting a lab-trained lifting identification model to the real-world. With performance much lower than on training data, we explored causes of the failure and proposed four potential solutions to increase model performance


title: Instance-Agnostic Geometry and Contact Dynamics Learning

abstract: This work presents an instance-agnostic learning framework that fuses vision with dynamics to simultaneously learn shape, pose trajectories, and physical properties via the use of geometry as a shared representation. Unlike many contact learning approaches that assume motion capture input and a known shape prior for the collision model, our proposed framework learns an object's geometric and dynamic properties from RGBD video, without requiring either category-level or instance-level shape priors. We integrate a vision system, BundleSDF, with a dynamics system, ContactNets, and propose a cyclic training pipeline to use the output from the dynamics module to refine the poses and the geometry from the vision module, using perspective reprojection. Experiments demonstrate our framework's ability to learn the geometry and dynamics of rigid and convex objects and improve upon the current tracking framework.


title: PACE-LM: Prompting and Augmentation for Calibrated Confidence Estimation with GPT-4 in Cloud Incident Root Cause Analysis

abstract: Major cloud providers have employed advanced AI-based solutions like large language models to aid humans in identifying the root causes of cloud incidents. Despite the growing prevalence of AI-driven assistants in the root cause analysis process, their effectiveness in assisting on-call engineers is constrained by low accuracy due to the intrinsic difficulty of the task, a propensity for LLM-based approaches to hallucinate, and difficulties in distinguishing these well-disguised hallucinations. To address this challenge, we propose to perform confidence estimation for the predictions to help on-call engineers make decisions on whether to adopt the model prediction. Considering the black-box nature of many LLM-based root cause predictors, fine-tuning or temperature-scaling-based approaches are inapplicable. We therefore design an innovative confidence estimation framework based on prompting retrieval-augmented large language models (LLMs) that demand a minimal amount of information from the root cause predictor. This approach consists of two scoring phases: the LLM-based confidence estimator first evaluates its confidence in making judgments in the face of the current incident that reflects its ``grounded-ness" level in reference data, then rates the root cause prediction based on historical references. An optimization step combines these two scores for a final confidence assignment. We show that our method is able to produce calibrated confidence estimates for predicted root causes, validate the usefulness of retrieved historical data and the prompting strategy as well as the generalizability across different root cause prediction models. Our study takes an important move towards reliably and effectively embedding LLMs into cloud incident management systems.


title: SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-supervised Skeleton-based Action Recognition

abstract: Contrastive learning has achieved great success in skeleton-based action recognition. However, most existing approaches encode the skeleton sequences as entangled spatiotemporal representations and confine the contrasts to the same level of representation. Instead, this paper introduces a novel contrastive learning framework, namely Spatiotemporal Clues Disentanglement Network (SCD-Net). Specifically, we integrate the decoupling module with a feature extractor to derive explicit clues from spatial and temporal domains respectively. As for the training of SCD-Net, with a constructed global anchor, we encourage the interaction between the anchor and extracted clues. Further, we propose a new masking strategy with structural constraints to strengthen the contextual associations, leveraging the latest development from masked image modelling into the proposed SCD-Net. We conduct extensive evaluations on the NTU-RGB+D (60&120) and PKU-MMD (I&II) datasets, covering various downstream tasks such as action recognition, action retrieval, transfer learning, and semi-supervised learning. The experimental results demonstrate the effectiveness of our method, which outperforms the existing state-of-the-art (SOTA) approaches significantly.


title: Cosmic Evolution Early Release Science Survey (CEERS): Multi-classing Galactic Dwarf Stars in the deep JWST/NIRCam

abstract: Low mass (sub)stellar objects represent the low end of the initial mass function, the transition to free-floating planets and a prominent interloper population in the search for high-redshift galaxies. Without proper motions or spectroscopy, can one identify these objects photometrically? JWST/NIRCam has several advantages over HST/WFC3 NIR: more filters, a greater wavelength range, and greater spatial resolution. Here, we present a catalogue of (sub)stellar dwarfs identified in the Cosmic Evolution Early Release Science Survey (CEERS). We identify 518 stellar objects down to $m_F200W \sim 28$ using half-light radius, a full three magnitudes deeper than typical HST/WFC3 images. A kNN nearest neighbour algorithm identifies and types these sources, using four HST/WFC3 and four NIRCam filters, trained on SpeX spectra of nearby brown dwarfs. The kNN with four neighbors classifies well within two subtypes: e.g M2$\pm$2 or T4$\pm$2, achieving $\sim$95% precision and recall. More granular typing results in worse metrics. In CEERS, we find 9 M8$\pm$2, 2 L6$\pm$2, 1 T4$\pm$2, and 15 T8$\pm$2. We compare the observed long wavelength NIRCam colours -- not used in the kNN -- to those expected for brown dwarf atmospheric models. The NIRCam F356W-F444W and F410M-F444W colours are redder by a magnitude for the type assigned by the kNN, hinting at a wider variety of atmospheres for these objects. We find a 300-350pc scale-height for M6$\pm$2 dwarfs plus a second structural component and a 150-200pc scale-height for T6$\pm$2 type dwarfs, consistent with literature values.


title: DKIST unveils the serpentine topology of quiet Sun magnetism in the photosphere

abstract: We present the first quiet Sun spectropolarimetric observations obtained with the Visible SpectroPolarimeter (ViSP) at the $4-$m Daniel K. Inouye Solar Telescope (DKIST). We recorded observations in a wavelength range that includes the magnetically sensitive Fe I $6301.5/6302.5$ $\AA$ doublet. With an estimated spatial resolution of 0.08'', this represents the highest spatial resolution full-vector spectropolarimetric observations ever obtained of the quiet Sun. We identified $53$ small-scale magnetic elements, including $47$ magnetic loops and $4$ unipolar magnetic patches, with linear and circular polarisation detected in all of them. Of particular interest is a magnetic element in which the polarity of the magnetic vector appears to change three times in only $400$ km and which has linear polarisation signals throughout. We find complex Stokes $V$ profiles at the polarity inversion lines of magnetic loops and discover degenerate solutions, as we are unable to conclusively determine whether these arise due to gradients in the atmospheric parameters or smearing of opposite polarity signals. We analyse a granule which notably has linear and circular polarisation signals throughout, providing an opportunity to explore its magnetic properties. On this small scale we see the magnetic field strength range from $25$ G at the granular boundary to $2$ kG in the intergranular lane (IGL), and sanity check the values with the weak and strong field approximations. A value of $2$ kG in the IGL is among the highest measurements ever recorded for the internetwork.


title: The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems

abstract: Recent years have seen significant progress in the realm of robot autonomy, accompanied by the expanding reach of robotic technologies. However, the emergence of new deployment domains brings unprecedented challenges in ensuring safe operation of these systems, which remains as crucial as ever. While traditional model-based safe control methods struggle with generalizability and scalability, emerging data-driven approaches tend to lack well-understood guarantees, which can result in unpredictable catastrophic failures. Successful deployment of the next generation of autonomous robots will require integrating the strengths of both paradigms. This article provides a review of safety filter approaches, highlighting important connections between existing techniques and proposing a unified technical framework to understand, compare, and combine them. The new unified view exposes a shared modular structure across a range of seemingly disparate safety filter classes and naturally suggests directions for future progress towards more scalable synthesis, robust monitoring, and efficient intervention.


title: Liu-type Shrinkage Estimators for Mixture of Poisson Regressions with Experts: A Heart Disease Study

abstract: Count data play a critical role in medical research, such as heart disease. The Poisson regression model is a common technique for evaluating the impact of a set of covariates on the count responses. The mixture of Poisson regression models with experts is a practical tool to exploit the covariates, not only to handle the heterogeneity in the Poisson regressions but also to learn the mixing structure of the population. Multicollinearity is one of the most common challenges with regression models, leading to ill-conditioned design matrices of Poisson regression components and expert classes. The maximum likelihood method produces unreliable and misleading estimates for the effects of the covariates in multicollinearity. In this research, we develop Ridge and Liu-type methods as two shrinkage approaches to cope with the ill-conditioned design matrices of the mixture of Poisson regression models with experts. Through various numerical studies, we demonstrate that the shrinkage methods offer more reliable estimates for the coefficients of the mixture model in multicollinearity while maintaining the classification performance of the ML method. The shrinkage methods are finally applied to a heart study to analyze the heart disease rate stages.


title: The Perseus ALMA Chemical Survey (PEACHES). III. Sulfur-bearing species tracing accretion and ejection processes in young protostars

abstract: (Abridged) Sulfur chemistry is poorly understood in the process of low-mass star and planet formation, where the main carriers of sulfur are still unknown. Despite the fact that simple S-bearing molecules are usually detected toward embedded sources, large surveys of S-bearing molecules with high angular resolution and sensitive observations are currently lacking. The goal of this work is to present an unbiased survey of simple sulfur-bearing species in protostars and provide new statistics. In addition, we investigate the role of S-bearing molecules in accretion processes and the connection between (non-)detection of complex organic molecules (COMs) and S-related species. We present the observations of sulfur-bearing species that are part of the Perseus ALMA Chemical Survey (PEACHES). We analyzed a total of 50 Class 0/I sources with an average angular resolution of about 0.6" (~180 au) in ALMA band 6. We present detection rates for CS, SO, 34SO, and SO2. The SO/34SO ratio is lower than the canonical value of 22 and the lowest values are found for those sources rich in COMs. This ratio, therefore, seems to be a good tracer of the inner high-density envelope. The detection of multiple COMs seems to be related to the presence of collimated outflows and SO2 emission seems to trace the warm gas in those sources where CH3OH is also detected. The SO2 abundances toward the PEACHES sample are, on average, two orders of magnitude lower than values from the Ophiuchus star-forming region and comparable with sources in Taurus, suggesting that the sulfur depletion in the gas-phase could depend on the external UV radiation. Finally, the SO2 emission detected in different evolutionary stages seems to arise from different physical mechanisms: high column density of warm material in Class 0 sources, shocks in Class I/II, and exposure to UV radiation from the protostar in more evolved Class II disks.


title: Self-Correlation and Cross-Correlation Learning for Few-Shot Remote Sensing Image Semantic Segmentation

abstract: Remote sensing image semantic segmentation is an important problem for remote sensing image interpretation. Although remarkable progress has been achieved, existing deep neural network methods suffer from the reliance on massive training data. Few-shot remote sensing semantic segmentation aims at learning to segment target objects from a query image using only a few annotated support images of the target class. Most existing few-shot learning methods stem primarily from their sole focus on extracting information from support images, thereby failing to effectively address the large variance in appearance and scales of geographic objects. To tackle these challenges, we propose a Self-Correlation and Cross-Correlation Learning Network for the few-shot remote sensing image semantic segmentation. Our model enhances the generalization by considering both self-correlation and cross-correlation between support and query images to make segmentation predictions. To further explore the self-correlation with the query image, we propose to adopt a classical spectral method to produce a class-agnostic segmentation mask based on the basic visual information of the image. Extensive experiments on two remote sensing image datasets demonstrate the effectiveness and superiority of our model in few-shot remote sensing image semantic segmentation. Code and models will be accessed at https://github.com/linhanwang/SCCNet.


title: WALLABY Pilot Survey: the Potential Polar Ring Galaxies NGC~4632 and NGC~6156

abstract: We report on the discovery of two potential polar ring galaxies (PRGs) in the WALLABY Pilot Data Release 1 (PDR1). These untargetted detections, cross-matched to NGC 4632 and NGC 6156, are some of the first galaxies where the Hi observations show two distinct components. We used the iDaVIE virtual reality software to separate the anomalous gas from the galactic gas and find that the anomalous gas comprises ~ 50% of the total H i content of both systems. We have generated plausible 3D kinematic models for each galaxy assuming that the rings are circular and inclined at 90 degrees to the galaxy bodies. These models show that the data are consistent with PRGs, but do not definitively prove that the galaxies are PRGs. By projecting these models at different combinations of main disk inclinations, ring orientations, and angular resolutions in mock datacubes, we have further investigated the detectability of similar PRGs in WALLABY. Assuming that these galaxies are indeed PRGs, the detectability fraction, combined with the size distribution of WALLABY PDR1 galaxies, implies an incidence rate of ~ 1% - 3%. If this rate holds true, the WALLABY survey will detect hundreds of new polar ring galaxies.


title: Fairness- and uncertainty-aware data generation for data-driven design

abstract: The design dataset is the backbone of data-driven design. Ideally, the dataset should be fairly distributed in both shape and property spaces to efficiently explore the underlying relationship. However, the classical experimental design focuses on shape diversity and thus yields biased exploration in the property space. Recently developed methods either conduct subset selection from a large dataset or employ assumptions with severe limitations. In this paper, fairness- and uncertainty-aware data generation (FairGen) is proposed to actively detect and generate missing properties starting from a small dataset. At each iteration, its coverage module computes the data coverage to guide the selection of the target properties. The uncertainty module ensures that the generative model can make certain and thus accurate shape predictions. Integrating the two modules, Bayesian optimization determines the target properties, which are thereafter fed into the generative model to predict the associated shapes. The new designs, whose properties are analyzed by simulation, are added to the design dataset. An S-slot design dataset case study was implemented to demonstrate the efficiency of FairGen in auxetic structural design. Compared with grid and randomized sampling, FairGen increased the coverage score at twice the speed and significantly expanded the sampled region in the property space. As a result, the generative models trained with FairGen-generated datasets showed consistent and significant reductions in mean absolute errors.


title: Optimizing Audio Augmentations for Contrastive Learning of Health-Related Acoustic Signals

abstract: Health-related acoustic signals, such as cough and breathing sounds, are relevant for medical diagnosis and continuous health monitoring. Most existing machine learning approaches for health acoustics are trained and evaluated on specific tasks, limiting their generalizability across various healthcare applications. In this paper, we leverage a self-supervised learning framework, SimCLR with a Slowfast NFNet backbone, for contrastive learning of health acoustics. A crucial aspect of optimizing Slowfast NFNet for this application lies in identifying effective audio augmentations. We conduct an in-depth analysis of various audio augmentation strategies and demonstrate that an appropriate augmentation strategy enhances the performance of the Slowfast NFNet audio encoder across a diverse set of health acoustic tasks. Our findings reveal that when augmentations are combined, they can produce synergistic effects that exceed the benefits seen when each is applied individually.


title: On well-posedness of a mildly dissipative family of active scalar equations in borderline Sobolev spaces

abstract: This paper considers a family of active scalar equations which modify the generalized surface quasi-geostrophic (gSQG) equations through its constitutive law or dissipative perturbations. These modifications are characteristically mild in the sense that they are logarithmic. The problem of well-posedness, in the sense of Hadamard, is then studied in a borderline setting of regularity in analog to the scaling-critical spaces of the gSQG equations. A novelty of the system considered is the nuanced form of smoothing provided by the proposed mild form of dissipation, which is able to support global well-posedness at the Euler endpoint, but in a setting where the inviscid counterpart is known to be ill-posed. A novelty of the analysis lies in the simultaneous treatment of modifications in the constitutive law, dissipative mechanism, and functional setting, which the existing literature has typically treated separately. A putatively sharp relation is identified between each of the distinct system-modifiers that is consistent with previous studies that considered these modifications in isolation. This unified perspective is afforded by the introduction of a linear model equation, referred to as the protean system, that successfully incorporates the more delicate commutator structure collectively possessed by the gSQG family and upon which each facet of well-posedness can be reduced to its study.


title: Effective Abnormal Activity Detection on Multivariate Time Series Healthcare Data

abstract: Multivariate time series (MTS) data collected from multiple sensors provide the potential for accurate abnormal activity detection in smart healthcare scenarios. However, anomalies exhibit diverse patterns and become unnoticeable in MTS data. Consequently, achieving accurate anomaly detection is challenging since we have to capture both temporal dependencies of time series and inter-relationships among variables. To address this problem, we propose a Residual-based Anomaly Detection approach, Rs-AD, for effective representation learning and abnormal activity detection. We evaluate our scheme on a real-world gait dataset and the experimental results demonstrate an F1 score of 0.839.


title: Designs and Implementations in Neural Network-based Video Coding

abstract: The past decade has witnessed the huge success of deep learning in well-known artificial intelligence applications such as face recognition, autonomous driving, and large language model like ChatGPT. Recently, the application of deep learning has been extended to a much wider range, with neural network-based video coding being one of them. Neural network-based video coding can be performed at two different levels: embedding neural network-based (NN-based) coding tools into a classical video compression framework or building the entire compression framework upon neural networks. This paper elaborates some of the recent exploration efforts of JVET (Joint Video Experts Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29) in the name of neural network-based video coding (NNVC), falling in the former category. Specifically, this paper discusses two major NN-based video coding technologies, i.e. neural network-based intra prediction and neural network-based in-loop filtering, which have been investigated for several meeting cycles in JVET and finally adopted into the reference software of NNVC. Extensive experiments on top of the NNVC have been conducted to evaluate the effectiveness of the proposed techniques. Compared with VTM-11.0_nnvc, the proposed NN-based coding tools in NNVC-4.0 could achieve {11.94%, 21.86%, 22.59%}, {9.18%, 19.76%, 20.92%}, and {10.63%, 21.56%, 23.02%} BD-rate reductions on average for {Y, Cb, Cr} under random-access, low-delay, and all-intra configurations respectively.


title: Purely anharmonic charge-density wave in the 2D Dirac semimetal SnP

abstract: Charge density waves (CDWs) in two-dimensional (2D) materials have been a major focus of research in condensed matter physics for several decades due to their potential for quantum-based technologies. In particular, CDWs can induce a metal-insulator transition by coupling two Dirac fermions, resulting in the emergence of a topological phase. Following this idea, here we explore the behavior of three different CDWs in a new 2D layered material, SnP, using both density functional theory calculations and experimental synthesis to study its stability. The layered structure of its bulk counterpart, Sn4P3, suggests that the structure can be synthesized down to the monolayer by exfoliation or chemical means. However, despite the stability of the bulk, the monolayer shows unstable phonons at {\Gamma}, K, and M points of the Brillouin zone, which lead to three possible charge-density-wave phases. All three CDWs lead to metastable insulating phases, with the one driven by the the active phonon in the K point being topologically non-trivial under strain. Strikingly, the ground-state structure is only revealed due to the presence of strong anharmonic effects. This, underscores the importance of studying CDWs beyond the conventional harmonic picture, where the system's ground state can be elucidated solely from the harmonic phonon spectra.


title: C=Anything and the switchback effect in Schwarzschild-de Sitter space

abstract: We investigate observables within the framework of the codimension-one C=Anything (CAny) proposal for Schwarzschild-de Sitter (SdS) space under the influence of shockwave sources. Within the proposal, there is a set of time-reversal invariant observables that display the same rate of growth at early and late-times for a background with or without shockwave sources. Once we introduce shockwaves in the weak gravitational coupling regime, there is a decrease in the late-time complexity growth due to cancellations with early-time perturbations, known as the switchback effect. The result shows that some CAny observables in SdS may reproduce the same type of behavior found in anti-de Sitter black holes. We comment on how our results might guide us to new explorations in the putative quantum mechanical theory.


title: A Novel Catastrophic Condition for Periodically Time-varying Convolutional Encoders Based on Time-varying Equivalent Convolutional Encoders

abstract: A convolutional encoder is said to be catastrophic if it maps an information sequence of infinite weight into a code sequence of finite weight. As a consequence of this mapping, a finite number of channel errors may cause an infinite number of information bit errors when decoding. This situation should be avoided. A catastrophic condition to determine if a time-invariant convolutional encoder is catastrophic or not is stated in \cite{Massey:LSC}. Palazzo developed this condition for periodically time-varying convolutional encoders in \cite{Palazzo:Analysis}. Since Palazzo's condition is based on the state transition table of the constituent encoders, its complexity increases exponentially with the number of memory elements in the encoders. A novel catastrophic condition making use of time-varying equivalent convolutional encoders is presented in this letter. A technique to convert a catastrophic periodically time-varying convolutional encoder into a non-catastrophic one can also be developed based on these encoders. Since they do not involve the state transitions of the convolutional encoder, the time complexity of these methods grows linearly with the encoder memory.


title: Predicting Interloper Fraction with Graph Neural Networks

abstract: Upcoming emission-line spectroscopic surveys, such as Euclid and the Roman Space Telescope, will be affected by systematic effects due to the presence of interlopers: galaxies whose redshift and distance from us are miscalculated due to line confusion in their emission spectra. Particularly pernicious are interlopers involving the confusion between two lines with close emitted wavelengths, like H$\beta$ emitters confused as \oiii, since those are strongly spatially correlated with the target galaxies. They introduce a particular pattern in the 3D distribution of the observed galaxy catalog that can shift the position of the BAO peak in the galaxy correlation function and bias any cosmological analysis performed with that sample. Here we present a novel method to predict the fraction of interlopers in a galaxy catalog, using Graph Neural Networks (GNNs) to learn the posterior distribution of the interloper fraction while marginalizing over cosmology and galaxy bias. The method is developed using simulations with halos acting as a proxy for galaxies. The GNN can infer the mean and standard deviation of the posterior distribution of interloper fraction using small-scale information that is usually not considered in cosmological analyses. The injection of large-scale information into the graph as a global attribute improves the performance of the GNN when marginalizing over cosmology.


title: Fourier Dimension Estimates for Sets of Exact Approximation Order: The Badly-Approximable Case

abstract: We show for decreasing, positive approximation functions $\psi$ such that $\tau = \lim_{q \to \infty} \frac{\log \psi(q)}{\log q} < \frac{13 + \sqrt{73}}{8}$ and such that $q^2 \psi(q) \to 0$ that the set $\text{Exact}(\psi)$ of numbers approximable to the exact order $\psi$ has positive Fourier dimension. This implies that the set $\text{Exact}(\psi)$ contains normal numbers.


title: Button Shear Testing for Adhesion Measurements of 2D Materials

abstract: Two-dimensional (2D) materials are considered for numerous applications in microelectronics, although several challenges remain when integrating them into functional devices. Weak adhesion is one of them, caused by their chemical inertness. Quantifying the adhesion of 2D materials on three-dimensional surfaces is, therefore, an essential step toward reliable 2D device integration. To this end, button shear testing is proposed and demonstrated as a method for evaluating the adhesion of 2D materials with the examples of graphene and hexagonal boron nitride (hBN), molybdenum disulfide, and tungsten diselenide on silicon dioxide (SiO${_2}$) and silicon nitride substrates. We propose a fabrication process flow for polymer buttons on the 2D materials and establish suitable button dimensions and testing shear speeds. We show with our quantitative data that low substrate roughness and oxygen plasma treatments on the substrates before 2D material transfer result in higher shear strengths. Thermal annealing increases the adhesion of hBN on SiO${_2}$ and correlates with the thermal interface resistance between these materials. This establishes button shear testing as a reliable and repeatable method for quantifying adhesion of 2D materials.


title: ChemSpaceAL: An Efficient Active Learning Methodology Applied to Protein-Specific Molecular Generation

abstract: The incredible capabilities of generative artificial intelligence models have inevitably led to their application in the domain of drug discovery. Within this domain, the vastness of chemical space motivates the development of more efficient methods for identifying regions with molecules that exhibit desired characteristics. In this work, we present a computationally efficient active learning methodology that requires evaluation of only a subset of the generated data in the constructed sample space to successfully align a generative model with respect to a specified objective. We demonstrate the applicability of this methodology to targeted molecular generation by fine-tuning a GPT-based molecular generator toward a protein with FDA-approved small-molecule inhibitors, c-Abl kinase. Remarkably, the model learns to generate molecules similar to the inhibitors without prior knowledge of their existence, and even reproduces two of them exactly. We also show that the methodology is effective for a protein without any commercially available small-molecule inhibitors, the HNH domain of the CRISPR-associated protein 9 (Cas9) enzyme. We believe that the inherent generality of this method ensures that it will remain applicable as the exciting field of in silico molecular generation evolves. To facilitate implementation and reproducibility, we have made all of our software available through the open-source ChemSpaceAL Python package.


title: Modeling Information Acquisition and Social Learning Dynamics: A Rational Inattention Perspective

abstract: Social learning, a fundamental process through which individuals shape their beliefs and perspectives via observation and interaction with others, is critical for the development of our society and the functioning of social governance. Prior works on social learning usually assume that the initial beliefs are given and focus on the update rule. With the recent proliferation of online social networks, there is an avalanche amount of information, which may significantly influence users' initial beliefs. In this paper, we use the rational inattention theory to model how agents acquire information to form initial beliefs and assess its influence on their adjustments in beliefs. Furthermore, we analyze the dynamic evolution of belief distribution among agents. Simulations and social experiments are conducted to validate our proposed model and analyze the impact of model parameters on belief dynamics.


title: Instabilities in Convnets for Raw Audio

abstract: What makes waveform-based deep learning so hard? Despite numerous attempts at training convolutional neural networks (convnets) for filterbank design, they often fail to outperform hand-crafted baselines. These baselines are linear time-invariant systems: as such, they can be approximated by convnets with wide receptive fields. Yet, in practice, gradient-based optimization leads to suboptimal approximations. In our article, we approach this phenomenon from the perspective of initialization. We present a theory of large deviations for the energy response of FIR filterbanks with random Gaussian weights. We find that deviations worsen for large filters and locally periodic input signals, which are both typical for audio signal processing applications. Numerical simulations align with our theory and suggest that the condition number of a convolutional layer follows a logarithmic scaling law between the number and length of the filters, which is reminiscent of discrete wavelet bases.


title: Multi-Point Detection of the Powerful Gamma Ray Burst GRB221009A Propagation through the Heliosphere on October 9, 2022

abstract: We present the results of processing the effects of the powerful Gamma Ray Burst GRB221009A captured by the charged particle detectors (electrostatic analyzers and solid-state detectors) onboard spacecraft at different points in the heliosphere on October 9, 2022. To follow the GRB221009A propagation through the heliosphere we used the electron and proton flux measurements from solar missions Solar Orbiter and STEREO-A; Earth magnetosphere and the solar wind missions THEMIS and Wind; meteorological satellites POES15, POES19, MetOp3; and MAVEN - a NASA mission orbiting Mars. GRB221009A had a structure of four bursts: less intense Pulse 1 - the triggering impulse - was detected by gamma-ray observatories at 131659 UT (near the Earth); the most intense Pulses 2 and 3 were detected on board all the spacecraft from the list, and Pulse 4 detected in more than 500 s after Pulse 1. Due to their different scientific objectives, the spacecraft, which data was used in this study, were separated by more than 1 AU (Solar Orbiter and MAVEN). This enabled tracking GRB221009A as it was propagating across the heliosphere. STEREO-A was the first to register Pulse 2 and 3 of the GRB, almost 100 seconds before their detection by spacecraft in the vicinity of Earth. MAVEN detected GRB221009A Pulses 2, 3, and 4 at the orbit of Mars about 237 seconds after their detection near Earth. By processing the time delays observed we show that the source location of the GRB221009A was at RA 288.5 degrees, Dec 18.5 degrees (J2000) with an error cone of 2 degrees


title: Radiomics Boosts Deep Learning Model for IPMN Classification

abstract: Intraductal Papillary Mucinous Neoplasm (IPMN) cysts are pre-malignant pancreas lesions, and they can progress into pancreatic cancer. Therefore, detecting and stratifying their risk level is of ultimate importance for effective treatment planning and disease control. However, this is a highly challenging task because of the diverse and irregular shape, texture, and size of the IPMN cysts as well as the pancreas. In this study, we propose a novel computer-aided diagnosis pipeline for IPMN risk classification from multi-contrast MRI scans. Our proposed analysis framework includes an efficient volumetric self-adapting segmentation strategy for pancreas delineation, followed by a newly designed deep learning-based classification scheme with a radiomics-based predictive approach. We test our proposed decision-fusion model in multi-center data sets of 246 multi-contrast MRI scans and obtain superior performance to the state of the art (SOTA) in this field. Our ablation studies demonstrate the significance of both radiomics and deep learning modules for achieving the new SOTA performance compared to international guidelines and published studies (81.9\% vs 61.3\% in accuracy). Our findings have important implications for clinical decision-making. In a series of rigorous experiments on multi-center data sets (246 MRI scans from five centers), we achieved unprecedented performance (81.9\% accuracy).


title: Uncovering mesa-optimization algorithms in Transformers

abstract: Transformers have become the dominant model in deep learning, but the reason for their superior performance is poorly understood. Here, we hypothesize that the strong performance of Transformers stems from an architectural bias towards mesa-optimization, a learned process running within the forward pass of a model consisting of the following two steps: (i) the construction of an internal learning objective, and (ii) its corresponding solution found through optimization. To test this hypothesis, we reverse-engineer a series of autoregressive Transformers trained on simple sequence modeling tasks, uncovering underlying gradient-based mesa-optimization algorithms driving the generation of predictions. Moreover, we show that the learned forward-pass optimization algorithm can be immediately repurposed to solve supervised few-shot tasks, suggesting that mesa-optimization might underlie the in-context learning capabilities of large language models. Finally, we propose a novel self-attention layer, the mesa-layer, that explicitly and efficiently solves optimization problems specified in context. We find that this layer can lead to improved performance in synthetic and preliminary language modeling experiments, adding weight to our hypothesis that mesa-optimization is an important operation hidden within the weights of trained Transformers.


title: Demystifying Statistical Matching Algorithms for Big Data

abstract: Statistical matching is an effective method for estimating causal effects in which treated units are paired with control units with ``similar'' values of confounding covariates prior to performing estimation. In this way, matching helps isolate the effect of treatment on response from effects due to the confounding covariates. While there are a large number of software packages to perform statistical matching, the algorithms and techniques used to solve statistical matching problems -- especially matching without replacement -- are not widely understood. In this paper, we describe in detail commonly-used algorithms and techniques for solving statistical matching problems. We focus in particular on the efficiency of these algorithms as the number of observations grow large. We advocate for the further development of statistical matching methods that impose and exploit ``sparsity'' -- by greatly restricting the available matches for a given treated unit -- as this may be critical to ensure scalability of matching methods as data sizes grow large.


title: Low-Energy Supernovae Bounds on Sterile Neutrinos

abstract: Sterile neutrinos can be produced through mixing with active neutrinos in the hot and dense core of a core-collapse supernova (SN). The standard bounds on the active-sterile mixing ($\sin^2 \theta$) from SN arise from SN1987A energy-loss, requiring $E_{\text{loss}}<10^{52}~{\rm erg}$. In this letter, we discuss a novel bound on sterile neutrino parameter space arising from the energy deposition through its decays inside the SN envelope. Using the observed underluminous SN IIP population, this energy deposition is constrained to be below $\sim 10^{50}~{\rm erg}$. Focusing on sterile neutrino mixing only with the tau neutrino, for heavy sterile masses $m_s$ in the range $100$-$500$ MeV, we find stringent constraints on $\sin^2 \theta_\tau$ reaching two orders of magnitude lower than those from the SN1987A energy-loss argument. Similar bounds will also be applicable to sterile mixing only with muons ($\sin^2 \theta_\mu$).


title: A two variable zeta function associated to the space of binary forms of degree $d$

abstract: In this paper we prove the analytic continuation of a two variable zeta function defined using the vector space of binary forms of degree $d$ to the entire two dimensional complex space as a meromorphic function.


title: Subgroup detection in linear growth curve models with generalized linear mixed model (GLMM) trees

abstract: Growth curve models are popular tools for studying the development of a response variable within subjects over time. Heterogeneity between subjects is common in such models, and researchers are typically interested in explaining or predicting this heterogeneity. We show how generalized linear mixed effects model (GLMM) trees can be used to identify subgroups with differently shaped trajectories in linear growth curve models. Originally developed for clustered cross-sectional data, GLMM trees are extended here to longitudinal data. The resulting extended GLMM trees are directly applicable to growth curve models as an important special case. In simulated and real-world data, we assess the performance of the extensions and compare against other partitioning methods for growth curve models. Extended GLMM trees perform more accurately than the original algorithm and LongCART, and similarly accurate as structural equation model (SEM) trees. In addition, GLMM trees allow for modeling both discrete and continuous time series, are less sensitive to (mis-)specification of the random-effects structure and are much faster to compute.


title: The bionic neural network for external simulation of human locomotor system

abstract: Muscle forces and joint kinematics estimated with musculoskeletal (MSK) modeling techniques offer useful metrics describing movement quality. Model-based computational MSK models can interpret the dynamic interaction between the neural drive to muscles, muscle dynamics, body and joint kinematics, and kinetics. Still, such a set of solutions suffers from high computational time and muscle recruitment problems, especially in complex modeling. In recent years, data-driven methods have emerged as a promising alternative due to the benefits of flexibility and adaptability. However, a large amount of labeled training data is not easy to be acquired. This paper proposes a physics-informed deep learning method based on MSK modeling to predict joint motion and muscle forces. The MSK model is embedded into the neural network as an ordinary differential equation (ODE) loss function with physiological parameters of muscle activation dynamics and muscle contraction dynamics to be identified. These parameters are automatically estimated during the training process which guides the prediction of muscle forces combined with the MSK forward dynamics model. Experimental validations on two groups of data, including one benchmark dataset and one self-collected dataset from six healthy subjects, are performed. The results demonstrate that the proposed deep learning method can effectively identify subject-specific MSK physiological parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion and muscle forces predictions.


title: On Cohen--Macaulay modules over the Weyl algebra

abstract: We propose a definition of Cohen--Macaulay modules over the Weyl algebra $D$ and give a sufficient condition for a GKZ $A$-hypergeometric $D$-module to be Cohen--Macaulay.


title: Force-directed graph embedding with hops distance

abstract: Graph embedding has become an increasingly important technique for analyzing graph-structured data. By representing nodes in a graph as vectors in a low-dimensional space, graph embedding enables efficient graph processing and analysis tasks like node classification, link prediction, and visualization. In this paper, we propose a novel force-directed graph embedding method that utilizes the steady acceleration kinetic formula to embed nodes in a way that preserves graph topology and structural features. Our method simulates a set of customized attractive and repulsive forces between all node pairs with respect to their hop distance. These forces are then used in Newton's second law to obtain the acceleration of each node. The method is intuitive, parallelizable, and highly scalable. We evaluate our method on several graph analysis tasks and show that it achieves competitive performance compared to state-of-the-art unsupervised embedding techniques.


title: ESG-coherent risk measures for sustainable investing

abstract: The growing interest in sustainable investing calls for an axiomatic approach to measures of risk and reward that focus not only on financial returns, but also on measures of environmental and social sustainability, i.e. environmental, social, and governance (ESG) scores. We propose definitions for ESG-coherent risk measures and ESG reward-risk ratios based on functions of bivariate random variables that are applied to financial returns and ESG scores, extending the traditional univariate measures to the ESG case. We provide examples and present an empirical analysis in which the ESG-coherent risk measures and ESG reward-risk ratios are used to rank stocks.


title: SkillScanner: Detecting Policy-Violating Voice Applications Through Static Analysis at the Development Phase

abstract: The Amazon Alexa marketplace is the largest Voice Personal Assistant (VPA) platform with over 100,000 voice applications (i.e., skills) published to the skills store. In an effort to maintain the quality and trustworthiness of voice-apps, Amazon Alexa has implemented a set of policy requirements to be adhered to by third-party skill developers. However, recent works reveal the prevalence of policy-violating skills in the current skills store. To understand the causes of policy violations in skills, we first conduct a user study with 34 third-party skill developers focusing on whether they are aware of the various policy requirements defined by the Amazon Alexa platform. Our user study results show that there is a notable gap between VPA's policy requirements and skill developers' practices. As a result, it is inevitable that policy-violating skills will be published. To prevent the inflow of new policy-breaking skills to the skills store from the source, it is critical to identify potential policy violations at the development phase. In this work, we design and develop SkillScanner, an efficient static code analysis tool to facilitate third-party developers to detect policy violations early in the skill development lifecycle. To evaluate the performance of SkillScanner, we conducted an empirical study on 2,451 open source skills collected from GitHub. SkillScanner effectively identified 1,328 different policy violations from 786 skills. Our results suggest that 32% of these policy violations are introduced through code duplication (i.e., code copy and paste). In particular, we found that 42 skill code examples from potential Alexa's official accounts (e.g., "alexa" and "alexa-samples" on GitHub) contain policy violations, which lead to 81 policy violations in other skills due to the copy-pasted code snippets from these Alexa's code examples.


title: Analysis of Randomized Householder-Cholesky QR Factorization with Multisketching

abstract: CholeskyQR2 and shifted CholeskyQR3 are two state-of-the-art algorithms for computing tall-and-skinny QR factorizations since they attain high performance on current computer architectures. However, to guarantee stability, for some applications, CholeskyQR2 faces a prohibitive restriction on the condition number of the underlying matrix to factorize. Shifted CholeskyQR3 is stable but has $50\%$ more computational and communication costs than CholeskyQR2. In this paper, a randomized QR algorithm called Randomized Householder-Cholesky (\texttt{rand\_cholQR}) is proposed and analyzed. Using one or two random sketch matrices, it is proved that with high probability, its orthogonality error is bounded by a constant of the order of unit roundoff for any numerically full-rank matrix, and hence it is as stable as shifted CholeskyQR3. An evaluation of the performance of \texttt{rand\_cholQR} on a NVIDIA A100 GPU demonstrates that for tall-and-skinny matrices, \texttt{rand\_cholQR} with multiple sketch matrices is nearly as fast as, or in some cases faster than, CholeskyQR2. Hence, compared to CholeskyQR2, \texttt{rand\_cholQR} is more stable with almost no extra computational or memory cost, and therefore a superior algorithm both in theory and practice.


title: On dissipation time scales of the basic second-order moments: the effect on the Energy and Flux-Budget (EFB) turbulence closure for stably stratified turbulence

abstract: The dissipation rates of the basic turbulent second-order moments are the key parameters controlling turbulence energetics and spectra, turbulent fluxes of momentum and heat, and playing a vital role in turbulence modelling. In this paper, we use the results of Direct Numerical Simulations (DNS) to evaluate dissipation rates of the basic turbulent second-order moments and revise the energy and flux-budget turbulence closure model for stably stratified turbulence. We delve into the theoretical implications of this approach and substantiate our closure hypotheses through DNS data. We also show why the concept of down-gradient turbulent transport becomes incomplete when applied to the vertical turbulent flux of potential temperature under very stable stratification. We reveal essential feedback between turbulent kinetic energy, the vertical flux of buoyancy and turbulent potential energy, which is responsible for maintaining shear-produced stably stratified turbulence up to extreme static stability.


title: Phase space deformations in SUSY cosmology

abstract: In this paper we propose a SUSY generalization for deformed phase-space cosmology. In particular, scalar field and phantom cosmology are studied. We construct the supercharges of the models and the SUSY Wheeler-DeWitt equation. We also construct and derive the classical dynamics using the WKB approximation.


title: Generalized Rainbow Differential Privacy

abstract: We study a new framework for designing differentially private (DP) mechanisms via randomized graph colorings, called rainbow differential privacy. In this framework, datasets are nodes in a graph, and two neighboring datasets are connected by an edge. Each dataset in the graph has a preferential ordering for the possible outputs of the mechanism, and these orderings are called rainbows. Different rainbows partition the graph of connected datasets into different regions. We show that if a DP mechanism at the boundary of such regions is fixed and it behaves identically for all same-rainbow boundary datasets, then a unique optimal $(\epsilon,\delta)$-DP mechanism exists (as long as the boundary condition is valid) and can be expressed in closed-form. Our proof technique is based on an interesting relationship between dominance ordering and DP, which applies to any finite number of colors and for $(\epsilon,\delta)$-DP, improving upon previous results that only apply to at most three colors and for $\epsilon$-DP. We justify the homogeneous boundary condition assumption by giving an example with non-homogeneous boundary condition, for which there exists no optimal DP mechanism.


title: Generalizations of the Schr\"odinger maximal operator: building arithmetic counterexamples

abstract: Let $T_t^{P_2}f(x)$ denote the solution to the linear Schr\"odinger equation at time $t$, with initial value function $f$, where $P_2 (\xi) = |\xi|^2$. In 1980, Carleson asked for the minimal regularity of $f$ that is required for the pointwise a.e. convergence of $T_t^{P_2} f(x)$ to $f(x)$ as $t \rightarrow 0.$ This was recently resolved by work of Bourgain, and Du and Zhang. This paper considers more general dispersive equations, and constructs counterexamples to pointwise a.e. convergence for a new class of real polynomial symbols $P$ of arbitrary degree, motivated by a broad question: what occurs for symbols lying in a generic class? We construct the counterexamples using number-theoretic methods, in particular the Weil bound for exponential sums, and the theory of Dwork-regular forms. This is the first case in which counterexamples are constructed for indecomposable forms, moving beyond special regimes where $P$ has some diagonal structure.


title: Contractivity of Distributed Optimization and Nash Seeking Dynamics

abstract: In this letter, we study distributed optimization and Nash equilibrium-seeking dynamics from a contraction theoretic perspective. Our first result is a novel bound on the logarithmic norm of saddle matrices. Second, for distributed gradient flows based upon incidence and Laplacian constraints over arbitrary topologies, we establish strong contractivity over an appropriate invariant vector subspace. Third, we give sufficient conditions for strong contractivity in pseudogradient and best response games with complete information, show the equivalence of these conditions, and consider the special case of aggregative games.


title: Cop-width, flip-width and strong colouring numbers

abstract: Cop-width and flip-width are new families of graph parameters introduced by Toru\'nczyk (2023) that generalise treewidth, degeneracy, generalised colouring numbers, clique-width and twin-width. In this paper, we bound the cop-width and flip-width of a graph by its strong colouring numbers. In particular, we show that for every $r\in \mathbb{N}$, every graph $G$ has $\text{copwidth}_r(G)\leq \text{scol}_{4r}(G)$. This implies that every class of graphs with linear strong colouring numbers has linear cop-width and linear flip-width. We use this result to deduce improved bounds for cop-width and flip-width for various sparse graph classes.


title: Assessment of Large Eddy Simulation (LES) Sub-grid Scale Models Accounting for Compressible Homogeneous Isotropic Turbulence

abstract: Most sub-grid scale (SGS) models employed in LES (large eddy simulation) formulations were originally developed for incompressible, single phase, inert flows and assume transfer of energy based on the classical energy cascade mechanism. Although they have been extended to numerically study compressible and reactive flows involving deflagrations and detonations, their accuracy in such sensitive and challenging flows is an open question. Therefore, there is a need for both assessing these existing SGS models and identifying the opportunities for proposing new ones, which properly characterize reacting flows in complex engine configurations such as those characterizing rotating detonation engines (RDEs). Accordingly, accounting for the decay of free homogeneous isotropic turbulence (HIT), this work provides a comparison of four different SGS models when compressibility effects are present, (i) the classical Smagorinsky model, (ii) the dynamic Smagorinsky model, (iii) the wall-adapting local eddy-viscosity (WALE) model, and (iv) the Vreman model. More specifically, SGS models are firstly implemented in the open-source computational tool PeleC, which is a high-fidelity finite-volume solver for compressible flows, and then numerical simulations are carried out using them. In terms of results, turbulent spectra, and the decay of physical quantities such as kinetic energy, enstrophy, temperature, and dilatation are computed for each SGS LES model and compared with direct numerical simulations (DNS) results available in literature. The LES numerical results obtained here highlight that the studied SGS models are capable of capturing the overall trends of all physical quantities accounted for. However, they also emphasize the need of improved SGS models capable of adequately describing turbulence dynamics in compressible flows.


title: Supernovae Ia and Gamma-Ray Bursts together shed new lights on the Hubble constant tension and cosmology

abstract: The LambdaCDM model is the most commonly accepted framework in modern cosmology. However, the local measurements of the Hubble constant, H0, via the Supernovae Type Ia (SNe Ia) calibrated on Cepheids provide a value which is in significant disagreement, from 4 to 6 sigma, with the value of H0 inferred from the Cosmic Microwave Background (CMB) observed by Planck. This disagreement is the so-called Hubble constant tension. To find out the reason for this discrepancy, we analyze the behaviour of the H0 in the Pantheon sample of SNe Ia through a binning approach: we divide the Pantheon into 3 and 4 bins ordered with redshift (z), and for each of them, we estimate the H0. After the H0 estimation, we fit the H0 values with a decreasing function of z, finding out that H0 undergoes a slow decreasing trend compatible with the evolution scenario in 2.0 sigma. [...] Together with SNe Ia, more astrophysical probes such as quasars (QSO) [...] and Gamma-Ray Bursts (GRBs) [...], are needed to tackle the H0 tension. In the realm of GRB-cosmology, one of the most promising correlations is the fundamental plane relation [...]. In the context of applying this relation as a cosmological tool, we also compute how many GRBs must be gathered to reach the same precision as the SNe Ia. Since we are about two decades away from reaching such precision, we also attempt to find additional correlations for the GRBs associated with SNe Ibc that could be exploited to standardize the class of GRB-SNe Ibc in the future. We find a hint of a correlation between the GRBs' end-of-plateau optical luminosity and the SNe's rest-frame peak time, suggesting that the GRBs with the most luminous optical plateau emission are associated with SNe with the most delayed peaks in their light curves. So far, it is the fundamental plane relation to be the most promising candle for exploring the high-z universe.


title: Choosing restart strategy at partial knowledge of process statistics

abstract: Optimization of a random processes by restart is a subject of active theoretical research in statistical physics and has long found practical application in computer science. Meanwhile, one of the key issues remains largely unsolved: when should we restart a process whose detailed statistics are unknown to ensure that our intervention will improve performance? Addressing this query here we propose several constructive criteria for the effectiveness of various protocols of non-instantaneous restart in the mean completion time problem and in the success probability problem. Being expressed in terms of a small number of easily estimated statistical characteristics of the original process, these criteria allow informed restart decision based on partial information.


title: Reaction coordinate flows for model reduction of molecular kinetics

abstract: In this work, we introduce a flow based machine learning approach, called reaction coordinate (RC) flow, for discovery of low-dimensional kinetic models of molecular systems. The RC flow utilizes a normalizing flow to design the coordinate transformation and a Brownian dynamics model to approximate the kinetics of RC, where all model parameters can be estimated in a data-driven manner. In contrast to existing model reduction methods for molecular kinetics, RC flow offers a trainable and tractable model of reduced kinetics in continuous time and space due to the invertibility of the normalizing flow. Furthermore, the Brownian dynamics-based reduced kinetic model investigated in this work yields a readily discernible representation of metastable states within the phase space of the molecular system. Numerical experiments demonstrate how effectively the proposed method discovers interpretable and accurate low-dimensional representations of given full-state kinetics from simulations.

categories: cs.LG math.DS physics.chem-ph physics.data-an stat.ML


title: Generalized Attacks on Face Verification Systems

abstract: Face verification (FV) using deep neural network models has made tremendous progress in recent years, surpassing human accuracy and seeing deployment in various applications such as border control and smartphone unlocking. However, FV systems are vulnerable to Adversarial Attacks, which manipulate input images to deceive these systems in ways usually unnoticeable to humans. This paper provides an in-depth study of attacks on FV systems. We introduce the DodgePersonation Attack that formulates the creation of face images that impersonate a set of given identities while avoiding being identified as any of the identities in a separate, disjoint set. A taxonomy is proposed to provide a unified view of different types of Adversarial Attacks against FV systems, including Dodging Attacks, Impersonation Attacks, and Master Face Attacks. Finally, we propose the ''One Face to Rule Them All'' Attack which implements the DodgePersonation Attack with state-of-the-art performance on a well-known scenario (Master Face Attack) and which can also be used for the new scenarios introduced in this paper. While the state-of-the-art Master Face Attack can produce a set of 9 images to cover 43.82% of the identities in their test database, with 9 images our attack can cover 57.27% to 58.5% of these identifies while giving the attacker the choice of the identity to use to create the impersonation. Moreover, the 9 generated attack images appear identical to a casual observer.


title: Unconventional superconducting pairing in a B20 Kramers Weyl semimetal

abstract: Topological superconductors present an ideal platform for exploring nontrivial superconductivity and realizing Majorana boundary modes in materials. However, finding a single-phase topological material with nontrivial superconducting states is a challenge. Here, we predict nontrivial superconductivity in the pristine chiral metal RhGe with a transition temperature of 5.8 K. Chiral symmetries in RhGe enforce multifold Weyl fermions at high-symmetry momentum points and spin-polarized Fermi arc states that span the whole surface Brillouin zone. These bulk and surface chiral states support multiple type-II van Hove singularities that enhance superconductivity in RhGe. Our detailed analysis of superconducting pairing symmetries involving Chiral Fermi pockets in RhGe, indicates the presence of nontrivial superconducting pairing. Our study establishes RhGe as a promising candidate material for hosting mixed-parity pairing and topological superconductivity.


title: On the pre- and post-positional semi-random graph processes

abstract: We study the semi-random graph process, and a variant process recently suggested by Nick Wormald. We show that these two processes are asymptotically equally fast in constructing a semi-random graph $G$ that has property ${\mathcal P}$, for the following examples of ${\mathcal P}$: - ${\mathcal P}$ is the set of graphs containing a $d$-degenerate subgraph, where $d\ge 1$ is fixed; - ${\mathcal P}$ is the set of $k$-connected graphs, where $k\ge 1$ is fixed. In particular, our result of the $k$-connectedness above settles the open case $k=2$ of the original semi-random graph process. We also prove that there exist properties ${\mathcal P}$ where the two semi-random graph processes do not construct a graph in ${\mathcal P}$ asymptotically equally fast. We further propose some conjectures on ${\mathcal P}$ for which the two processes perform differently.


title: Fluid Dynamic Simulations of Mach and Regular Reflections in Oblique Shock-Wave Configurations using Adaptive Mesh Refinement

abstract: In the context of the interaction between a moving plane shock wave and an inclined wall (wedge), it is possible to distinguish four distinct shock reflection configurations. These shock wave reflections, which depend on the characteristics of the incident shock wave and the geometry of the surface that it interacts with, are (i) regular reflection (RR), (ii) simple Mach reflection (SMR), (iii) transition Mach reflection (TMR), and (iv) double Mach reflection (DMR). The impact of these shock reflections on flow properties can be significant so understanding them is important when predicting the behavior of shock waves in more complex flow configurations. Previous research works have explored the referred shock reflections through both numerical and experimental approaches, employing various gases and different flow and geometrical configurations. The present study involves the use of a high-fidelity computational fluid dynamics (CFD) tool, known as PeleC, which is a compressible solver based on AMReX specifically designed to handle complex flow configurations. Accordingly, by solving the time-dependent Euler equations for various 2D flow configurations, this work studies shock wave reflections accounting for four different Mach-based operating conditions and compares and analyzes the resulting density profiles on the wedge wall with experimental data. To strike a balance between model accuracy and computational efficiency, adaptive mesh refinement (AMR) is incorporated, and a mesh independence study is performed by varying the number of AMR levels. The results of this study demonstrate the capabilities of the CFD tool employed as it accurately predicts the sensitivity of wave characteristics to different operating conditions.


title: Hierarchical Conditional Semi-Paired Image-to-Image Translation For Multi-Task Image Defect Correction On Shopping Websites

abstract: On shopping websites, product images of low quality negatively affect customer experience. Although there are plenty of work in detecting images with different defects, few efforts have been dedicated to correct those defects at scale. A major challenge is that there are thousands of product types and each has specific defects, therefore building defect specific models is unscalable. In this paper, we propose a unified Image-to-Image (I2I) translation model to correct multiple defects across different product types. Our model leverages an attention mechanism to hierarchically incorporate high-level defect groups and specific defect types to guide the network to focus on defect-related image regions. Evaluated on eight public datasets, our model reduces the Frechet Inception Distance (FID) by 24.6% in average compared with MoNCE, the state-of-the-art I2I method. Unlike public data, another practical challenge on shopping websites is that some paired images are of low quality. Therefore we design our model to be semi-paired by combining the L1 loss of paired data with the cycle loss of unpaired data. Tested on a shopping website dataset to correct three image defects, our model reduces (FID) by 63.2% in average compared with WS-I2I, the state-of-the art semi-paired I2I method.


title: Accelerating Quantum Optimal Control of Multi-Qubit Systems with Symmetry-Based Hamiltonian Transformations

abstract: We present a novel, computationally efficient approach to accelerate quantum optimal control calculations of large multi-qubit systems used in a variety of quantum computing applications. By leveraging the intrinsic symmetry of finite groups, the Hilbert space can be decomposed and the Hamiltonians block-diagonalized to enable extremely fast quantum optimal control calculations. Our approach reduces the Hamiltonian size of an $n$-qubit system from 2^n by 2^n to O(n by n) or O((2^n / n) by (2^n / n)) under Sn or Dn symmetry, respectively. Most importantly, this approach reduces the computational runtime of qubit optimal control calculations by orders of magnitude while maintaining the same accuracy as the conventional method. As prospective applications, we show that (1) symmetry-protected subspaces can be potential platforms for quantum error suppression and simulation of other quantum Hamiltonians, and (2) Lie-Trotter-Suzuki decomposition approaches can generalize our method to a general variety of multi-qubit systems.


title: Modeling Reachability Types with Logical Relations

abstract: Reachability types are a recent proposal to bring Rust-style reasoning about memory properties to higher-level languages. While key type soundness results for reachability types have been established using syntactic techniques in prior work, stronger metatheoretic properties have so far been unexplored. This paper presents an alternative semantic model of reachability types using logical relations, providing a framework in which to study key properties of interest such as (1) semantic type soundness, including of not syntactically well-typed code fragments, (2) termination, especially in the presence of higher-order state, and (3) program equivalence, especially reordering of non-interfering expressions for parallelization or compiler optimization.


title: Inductive Proof of Borchardt's Theorem

abstract: We provide an inductive proof of Borchardt's theorem for calculating the permanent of a Cauchy matrix via the determinants of auxiliary matrices. This result has implications for antisymmetric products of interacting geminals (APIG), and suggests that the restriction of the APIG coefficients to Cauchy form (typically called APr2G) is special in its tractability.


title: An Enhanced Cross-Sectional HIV Incidence Estimator that Incorporates Prior HIV Test Results

abstract: Incidence estimation of HIV infection can be performed using recent infection testing algorithm (RITA) results from a cross-sectional sample. This allows practitioners to understand population trends in the HIV epidemic without having to perform longitudinal follow-up on a cohort of individuals. The utility of the approach is limited by its precision, driven by the (low) sensitivity of the RITA at identifying recent infection. By utilizing results of previous HIV tests that individuals may have taken, we consider an enhanced RITA with increased sensitivity (and specificity). We use it to propose an enhanced estimator for incidence estimation. We prove the theoretical properties of the enhanced estimator and illustrate its numerical performance in simulation studies. We apply the estimator to data from a cluster-randomized trial to study the effect of community-level HIV interventions on HIV incidence. We demonstrate that the enhanced estimator provides a more precise estimate of HIV incidence compared to the standard estimator.


title: Geometrically regular weighted shifts

abstract: We study a general class of weighted shifts whose weights $\alpha$ are given by $\alpha_n = \sqrt{\frac{p^n + N}{p^n + D}}$, where $p > 1$ and $N$ and $D$ are parameters so that $(N,D) \in (-1, 1)\times (-1, 1)$. Some few examples of these shifts have appeared previously, usually as examples in connection with some property related to subnormality. In sectors nicely arranged in the unit square in $(N,D)$, we prove that these geometrically regular weighted shifts exhibit a wide variety of properties: moment infinitely divisible, subnormal, $k$- but not $(k+1)$-hyponormal, or completely hyperexpansive, and with a variety of well-known functions (such as Bernstein functions) interpolating their weights squared or their moment sequences. They provide subshifts of the Bergman shift with geometric, not linear, spacing in the weights which are moment infinitely divisible. This new family of weighted shifts provides a useful addition to the library of shifts with which to explore new definitions and properties.


title: Systemization of Knowledge (SoK)- Cross Impact of Transfer Learning in Cybersecurity: Offensive, Defensive and Threat Intelligence Perspectives

abstract: Recent literature highlights a significant cross-impact between transfer learning and cybersecurity. Many studies have been conducted on using transfer learning to enhance security, leading to various applications in different cybersecurity tasks. However, previous research is focused on specific areas of cybersecurity. This paper presents a comprehensive survey of transfer learning applications in cybersecurity by covering a wide range of domains, identifying current trends, and shedding light on under-explored areas. The survey highlights the significance of transfer learning in addressing critical issues in cybersecurity, such as improving detection accuracy, reducing training time, handling data imbalance, and enhancing privacy preservation. Additional insights are provided on the common problems solved using transfer learning, such as the lack of labeled data, different data distributions, and privacy concerns. The paper identifies future research directions and challenges that require community attention, including the need for privacy-preserving models, automatic tools for knowledge transfer, metrics for measuring domain relatedness, and enhanced privacy preservation mechanisms. The insights and roadmap presented in this paper will guide researchers in further advancing transfer learning in cybersecurity, fostering the development of robust and efficient cybersecurity systems to counter emerging threats and protect sensitive information. To the best of our knowledge, this paper is the first of its kind to present a comprehensive taxonomy of all areas of cybersecurity that benefited from transfer learning and propose a detailed future roadmap to shape the possible research direction in this area.


title: Pentagon, Hexagon, or Bridge? Identifying the Location of a Single Vanadium Cation on Buckminsterfullerene Surface

abstract: Buckminsterfullerene C60 has received extensive research interest ever since its discovery. In addition to its interesting intrinsic properties of exceptional stability and electron-accepting ability, the broad chemical tunability by decoration or substitution on the C60-fullerene surface makes it a fascinating molecule. However, to date there is uncertainty about the binding location of such decorations on the C60 surface, even for a single adsorbed metal atom. In this work, we report the gas-phase synthesis of the C60V+ complex and its in-situ characterization by mass spectrometry and in-frared spectroscopy with the help of quantum chemical calculations and molecular dynamics simulations. We identify the most probable binding position of a vanadium cation on C60 above a pentagon center in eta5-fashion, demonstrate a high thermal stability for this complex, and explore the bonding nature between C60 and the vanadium cation, reveal-ing that large orbital and electrostatic interactions lie at the origin of the stability of the eta5-C60V+ complex.


title: Evolution of negative superhumps, quasi-periodic oscillations and outbursts in the Z Cam-type dwarf nova AH Her

abstract: AH Her is a Z Cam-type dwarf nova with an orbital period of ~ 0.258 d. Dwarf nova oscillations and long-period dwarf nova oscillations have been detected, but no quasi-periodic oscillations (QPOs) and negative superhumps (NSHs) have been found. We investigated the association between NSHs, QPOs, and outbursts of AH Her based on \textit{TESS} photometry. We find for the first time the NSHs with a period of 0.24497(1) d in AH Her, and trace the variation of the amplitude and period of NSHs with the outburst. The amplitude of the NSHs is most significant at quiescence, weakening as the outburst rises, becoming undetectable at the top, rebounding and weakening at the plateau, and strengthening again as the outburst declines. The variation of the accretion disk radius can explain the NSHs amplitude variation except for the plateau, so we suggest that the relationship between NSHs amplitude and outburst can be used as a window to study the accretion disk instability and the origin of NSHs. In addition, we find the periodic variations in the amplitude, maxima, and shape of the NSHs ranging from 2.33(2) d to 2.68(5) d, which may be related to the precession of the tilted disk. Finally, we find QPOs at the top of AH Her's long outburst with ~ 2800 s similar to HS 2325+8205, suggesting that the presence of QPOs at the top of Z Cam's long outburst may be a general phenomenon


title: Distributionally-Informed Recommender System Evaluation

abstract: Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additional metrics for considerations such as diversity and novelty. In this paper, we argue for the need for researchers and practitioners to attend more closely to various distributions that arise from a recommender system (or other information access system) and the sources of uncertainty that lead to these distributions. One immediate implication of our argument is that both researchers and practitioners must report and examine more thoroughly the distribution of utility between and within different stakeholder groups. However, distributions of various forms arise in many more aspects of the recommender systems experimental process, and distributional thinking has substantial ramifications for how we design, evaluate, and present recommender systems evaluation and research results. Leveraging and emphasizing distributions in the evaluation of recommender systems is a necessary step to ensure that the systems provide appropriate and equitably-distributed benefit to the people they affect.


title: Numerical Study of Distorted Tulip Flame Propagation in Confined Systems

abstract: Understanding the dynamics of premixed flames that propagates in confined systems is important in a wide range of applications. The study of premixed flames propagating in a closed channel covers a variety of complexities related to flame ignition, laminar flame development, and strong non-linear interaction between the flame and the surrounding walls. Accordingly, to study the dynamics of premixed flames propagating in closed channels, numerical simulations of the propagation of distorted tulip flames are carried out in this work. More specifically, a set of fully reactive compressible transport equations are solved here using the high-order PPM. A 21-step chemical kinetic mechanism is employed to model the chemical kinetics and the energy release in an air-hydrogen mixture. Computational mesh independence studies are carried out in this work by both refining grid elements and employing different levels of adaptive mesh refinements (AMR). The main results show that the classic tulip flame behavior evolves into a distorted one. Indeed, two consecutive collapses on the flame front are observed, which are related to wave pressure and the presence of reverse flow. It is particularly found that the pressure wave produced by the interaction of the flame skirt with the side walls reduces the flame velocity and contributes to the formation of tulip flames. This is consistent with the reduction in both flame area and pressure gradient at the flame tip. Furthermore, the collapse of flame cups is associated with the formation of the vortex near the channel side walls and the increase of pressure waves.


title: Fast Constraint Screening for Multi-Interval Unit Commitment

abstract: Power systems Unit Commitment (UC) problem determines the generator commitment schedule and dispatch decisions for power networks based on forecasted electricity demand. However, with the increasing penetration of renewables and stochastic demand behaviors, it becomes challenging to solve the large-scale, multi-interval UC problem in an efficient manner. The main objective of this paper is to propose a fast and reliable scheme to eliminate a set of redundant or inactive physical constraints in the high-dimensional, multi-interval, mixed-integer UC problem, while the reduced problem is equivalent to the original full problem in terms of commitment decisions. Our key insights lie on pre-screening the constraints based on the load distribution and considering the physical feasibility regions of multi-interval UC problem. For the multistep UC formulation, we overcome screening conservativeness by utilizing the multi-step ramping relationships, and can reliably screen out more constraints compared to current practice. Extensive simulations on both specific load samples and load regions validate the proposed technique can screen out more than 80% constraints while preserving the feasibility of multi-interval UC problem.


title: Coexistence of near-EF flat band and van Hove singularity in a two-phase superconductor

abstract: In quantum many-body systems, particularly, the ones with large near-EF density states, like flat bands or van Hove singularity (VHS), electron correlations often give rise to rich phase diagrams with multiple coexisting/competing orders occurring at similar energy scales. The recently discovered locally noncentrosymmetric heavy fermion superconductor CeRh2As2 has stimulated extensive attention due to its unusual H-T phase diagram, consisting of two-phase superconductivity, antiferromagnetic order, and possible quadrupole-density wave orders. However, despite its great importance, the near-EF electronic structure remains experimentally elusive. Here, we provide this key information by combining soft X-ray and vacuum ultraviolet (VUV) angle-resolved photoemission spectroscopy measurements and atom-resolved DFT+U calculations. With bulk-sensitive soft X-rays, we reveal quasi-2D hole- and 3D electron- pockets with a pronounced nesting feature. Most importantly, we observe a symmetry-protected fourfold VHS coexisting with the Ce 4f flat bands near the EF, which, to the best of our knowledge, has never been reported before. Such a rare coexistence is expected to lead to a large density of states at the zone edge, enhancement in electron correlations, and a large upper critical field of the odd-parity superconducting phase. Uniquely, it will also result in a new type of f-VHS hybridization that alters the order and fine electronic structure of the symmetry-protected VHS and flat bands. These peculiarities offer important dimensions for understanding the reported rich phase diagram and are discussed as an origin of superconductivity with two phases. Our findings not only provide key insights into the nature of multiple phases in CeRh$_2$As$_2$, but also open up new prospects for exploring the novelties of many-body systems with f-VHS hybridization.


title: Silicon charge pump operation limit above and below liquid helium temperature

abstract: Semiconductor tunable barrier single-electron pumps can produce output current of hundreds of picoamperes at sub ppm precision, approaching the metrological requirement for the direct implementation of the current standard. Here, we operate a silicon metal-oxide-semiconductor electron pump up to a temperature of 14 K to understand the temperature effect on charge pumping accuracy. The uncertainty of the charge pump is tunnel limited below liquid helium temperature, implying lowering the temperature further does not greatly suppress errors. Hence, highly accurate charge pumps could be confidently achieved in a $^4$He cryogenic system, further promoting utilization of the revised quantum current standard across the national measurement institutes and industries worldwide.


title: Simulations of cross media showers with CORSIKA 8

abstract: The CORSIKA 8 project aims to develop a versatile and modern framework for particle shower simulations that meets the new needs of experiments and addresses the caveats of existing codes. Of particular relevance is the ability to compute particle showers that pass through two or more different media, of varying density, in a single run within a single code. CORSIKA 8 achieves this flexibility by using a volume tree that specifies volume containment, allowing one to quickly query to which medium a point belongs. Thanks to this design we are able to construct very specific environments with different geometries and media. As an example, we demonstrate this new functionality by running particle showers penetrating from air into Antarctic ice and validating them with a combination of the well-established CORSIKA 7 and GEANT4 codes.


title: Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing

abstract: This paper investigates the strategic decision-making capabilities of three Large Language Models (LLMs): GPT-3.5, GPT-4, and LLaMa-2, within the framework of game theory. Utilizing four canonical two-player games -- Prisoner's Dilemma, Stag Hunt, Snowdrift, and Prisoner's Delight -- we explore how these models navigate social dilemmas, situations where players can either cooperate for a collective benefit or defect for individual gain. Crucially, we extend our analysis to examine the role of contextual framing, such as diplomatic relations or casual friendships, in shaping the models' decisions. Our findings reveal a complex landscape: while GPT-3.5 is highly sensitive to contextual framing, it shows limited ability to engage in abstract strategic reasoning. Both GPT-4 and LLaMa-2 adjust their strategies based on game structure and context, but LLaMa-2 exhibits a more nuanced understanding of the games' underlying mechanics. These results highlight the current limitations and varied proficiencies of LLMs in strategic decision-making, cautioning against their unqualified use in tasks requiring complex strategic reasoning.


title: Kinetic Suppression of Photoinduced Halide Migration in Wide Bandgap Perovskites via Surface Passivation

abstract: In this work, we study the kinetics of photoinduced halide migration in FA$_{0.8}$Cs$_{0.2}$Pb(I$_{0.8}$Br$_{0.2}$)$_3$ wide (~1.69 eV) bandgap perovskites and show halide migration slows down following surface passivation with (3-aminopropyl) trimethoxysilane (APTMS). We use scanning Kelvin probe microscopy (SKPM) to probe the contact potential difference (CPD) shift under illumination, and the kinetics of surface potential relaxation in the dark. Our results show APTMS-passivated perovskites exhibit a smaller CPD shift under illumination, and a slower surface potential relaxation in the dark. We compare the evolution of the photoluminescence spectra of APTMS-passivated and unpassivated perovskites under illumination. We find that APTMS-passivated perovskites exhibit more than 5 times slower photoluminescence redshift, consistent with the slower surface potential relaxation as observed by SKPM. These observations provide evidence for kinetic suppression of photoinduced halide migration in APTMS-passivated samples, likely due to reduced halide vacancy densities, opening avenues to more efficient and stable devices.


title: Adversarial Attacks Assessment of Salient Object Detection via Symbolic Learning

abstract: Machine learning is at the center of mainstream technology and outperforms classical approaches to handcrafted feature design. Aside from its learning process for artificial feature extraction, it has an end-to-end paradigm from input to output, reaching outstandingly accurate results. However, security concerns about its robustness to malicious and imperceptible perturbations have drawn attention since its prediction can be changed entirely. Salient object detection is a research area where deep convolutional neural networks have proven effective but whose trustworthiness represents a significant issue requiring analysis and solutions to hackers' attacks. Brain programming is a kind of symbolic learning in the vein of good old-fashioned artificial intelligence. This work provides evidence that symbolic learning robustness is crucial in designing reliable visual attention systems since it can withstand even the most intense perturbations. We test this evolutionary computation methodology against several adversarial attacks and noise perturbations using standard databases and a real-world problem of a shorebird called the Snowy Plover portraying a visual attention task. We compare our methodology with five different deep learning approaches, proving that they do not match the symbolic paradigm regarding robustness. All neural networks suffer significant performance losses, while brain programming stands its ground and remains unaffected. Also, by studying the Snowy Plover, we remark on the importance of security in surveillance activities regarding wildlife protection and conservation.


title: Concurrent Composition for Interactive Differential Privacy with Adaptive Privacy-Loss Parameters

abstract: In this paper, we study the concurrent composition of interactive mechanisms with adaptively chosen privacy-loss parameters. In this setting, the adversary can interleave queries to existing interactive mechanisms, as well as create new ones. We prove that every valid privacy filter and odometer for noninteractive mechanisms extends to the concurrent composition of interactive mechanisms if privacy loss is measured using $(\epsilon, \delta)$-DP, $f$-DP, or R\'enyi DP of fixed order. Our results offer strong theoretical foundations for enabling full adaptivity in composing differentially private interactive mechanisms, showing that concurrency does not affect the privacy guarantees. We also provide an implementation for users to deploy in practice.


title: The Game of Cycles with Sources Allowed

abstract: In this paper, we introduce a variant of Francis Su's "Game of Cycles," that we call "Cycles with Sources." The only change to the rules is permitting nodes to be sources, while sinks are still prohibited. Despite this minor change in the rules, we show that even on simple games, like line graphs, there is a great change in the outcome of optimal play, which we fully analyze using Sprague-Grundy Theory.


title: Interlacing property of a family of generating polynomials over Dyck paths

abstract: In the study of a tantalizing symmetry on Catalan objects, B\'ona et al. introduced a family of polynomials $\{W_{n,k}(x)\}_{n\geq k\geq 0}$ defined by \begin{align*} W_{n,k}(x)=\sum_{m=0}^{k}w_{n,k,m}x^{m}, \end{align*} where $w_{n,k,m}$ counts the number of Dyck paths of semilength $n$ with $k$ occurrences of $UD$ and $m$ occurrences of $UUD$. They proposed two conjectures on the interlacing property of these polynomials, one of which states that $\{W_{n,k}(x)\}_{n\geq k}$ is a Sturm sequence for any fixed $k\geq 1$, and the other states that $\{W_{n,k}(x)\}_{1\leq k\leq n}$ is a Sturm-unimodal sequence for any fixed $n\geq 1$. In this paper, we obtain certain recurrence relations for $W_{n,k}(x)$, and further confirm their conjectures.


title: Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning

abstract: Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face a number of challenges, such as the requirement for fine-grained knowledge understanding in computer-aided diagnosis and capability of utilizing very limited or no task-specific labeled data in real-world clinical applications. In this study, we present MaCo, a novel multi-modal medical foundation model that explores masked contrastive learning to achieve granular alignment and zero-shot learning for a variety of medical imaging tasks. MaCo incorporates a correlation weighting mechanism to adjust the correlation between masked image patches and their corresponding reports, thereby enhancing the representation learning capabilities. We evaluate MaCo on six well-known open-source X-ray datasets, and the experimental results show it outperforms seven state-of-the-art approaches for classification, segmentation, and zero-shot phase grounding, demonstrating its great potential to promote a wide range of medical image analysis tasks.


title: Geometry Enhanced Optimal Control Technique for Acrobatic Flip Motion of Quadcopter

abstract: A nonlinear optimal control strategy, named the geometry enhanced finite time $\boldsymbol{\theta-}$D technique, is proposed to manipulate the acrobatic flip flight of variable pitch (VP) quadcopter unmanned aerial vehicles (abbreviated as VP copter). A unique superiority of the VP copter, which can provide the thrust in both positive and negative vertical directions by varying the pitch angles of blades, facilitates the acrobatic flip motion. The finite time $\boldsymbol{\theta-}$D technique can offer a closed-form near-optimal state feedback control law with online computational efficiency as compared with the finite time state-dependent Riccati equation (SDRE) technique. Meanwhile, by virtue of the geometric technique, the singularity issue of the rotation matrix in the acrobatic flip maneuver can be avoided. The simulation experiments verify the proposed control strategy is effective and efficient.