title: Mixed finite element methods for elliptic obstacle problems

abstract: Mixed variational formulations for the first-order system of the elastic membrane obstacle problem and the second-order system of the Kirchhoff--Love plate obstacle problem are proposed. The force exerted by the rigid obstacle is included as a new unknown. A priori and a posteriori error estimates are derived for both obstacle problems. The a posteriori error estimates are based on conforming postprocessed solutions. Numerical experiments conclude this work.


title: Cross-Modality Program Representation Learning for Electronic Design Automation with High-Level Synthesis

abstract: In recent years, domain-specific accelerators (DSAs) have gained popularity for applications such as deep learning and autonomous driving. To facilitate DSA designs, programmers use high-level synthesis (HLS) to compile a high-level description written in C/C++ into a design with low-level hardware description languages that eventually synthesize DSAs on circuits. However, creating a high-quality HLS design still demands significant domain knowledge, particularly in microarchitecture decisions expressed as \textit{pragmas}. Thus, it is desirable to automate such decisions with the help of machine learning for predicting the quality of HLS designs, requiring a deeper understanding of the program that consists of original code and pragmas. Naturally, these programs can be considered as sequence data. In addition, these programs can be compiled and converted into a control data flow graph (CDFG). But existing works either fail to leverage both modalities or combine the two in shallow or coarse ways. We propose ProgSG, a model that allows interaction between the source code sequence modality and the graph modality in a deep and fine-grained way. To alleviate the scarcity of labeled designs, a pre-training method is proposed based on a suite of compiler's data flow analysis tasks. Experimental results show that ProgSG reduces the RMSE of design performance predictions by up to $22\%$, and identifies designs with an average of $1.10\times$ and $1.26\times$ (up to $8.17\times$ and $13.31\times$) performance improvement in design space exploration (DSE) task compared to HARP and AutoDSE, respectively.


title: Gate voltage modulation of the superconducting state in a degenerate semiconductor

abstract: In this work, we demonstrate that the modulation of carrier density can alter the superconducting transition temperature by up to $204$ mK in epitaxial Indium Nitride on Gallium Nitride, accounting for the $10$% of the transition temperature in ungated conditions. Our samples are likely free from strong localization effects and significant granularity, as indicated by $( k_{f l} \gg 1 )$, suggesting that the primary determinant of the transition temperature in InN is carrier density, rather than disorder scattering. The observed behavior is consistent with BCS s-wave superconductivity, corroborated by the superconducting parameters we measured. Furthermore, we observed a $60$% bipolar suppression of the supercurrent in our experiments.


title: Human-Machine Interface Evaluation Using EEG in Driving Simulator

abstract: Automated vehicles are pictured as the future of transportation, and facilitating safer driving is only one of the many benefits. However, due to the constantly changing role of the human driver, users are easily confused and have little knowledge about their responsibilities. Being the bridge between automation and human, the human-machine interface (HMI) is of great importance to driving safety. This study was conducted in a static driving simulator. Three HMI designs were developed, among which significant differences in mental workload using NASA-TLX and the subjective transparency test were found. An electroencephalogram was applied throughout the study to determine if differences in the mental workload could also be found using EEG's spectral power analysis. Results suggested that more studies are required to determine the effectiveness of the spectral power of EEG on mental workload, but the three interface designs developed in this study could serve as a solid basis for future research to evaluate the effectiveness of psychophysiological measures. Marie Sklodowska-Curie Actions; Innovative Training Network (ITN); SHAPE-IT; Grant number 860410; Publication date: [27 July 2023]; DOI: [10.1109/IV55152.2023.10186567]


title: Hierarchical Control for Vehicle Repositioning in Autonomous Mobility on Demand Systems

abstract: Balancing passenger demand and vehicle availability is crucial for ensuring the sustainability and effectiveness of urban transportation systems. To address this challenge, we propose a novel hierarchical strategy for the efficient distribution of empty vehicles in urban areas. The proposed approach employs a data-enabled predictive control algorithm to develop a high-level controller, which guides the inter-regional allocation of idle vehicles. This algorithm utilizes historical data on passenger demand and vehicle supply in each region to construct a non-parametric representation of the system, enabling it to determine the optimal number of vehicles to be repositioned or retained in their current regions without modeling the system. At the low level, a coverage control-based controller is designed to provide inter-regional position guidance, determining the desired road intersection each vehicle should target. With the objective of optimizing area coverage, it aligns the vehicle distribution with the demand across different districts within a single region. The effectiveness of the proposed method is validated through simulation experiments on the real road network of Shenzhen, China. The integration of the two layers provides better performance compared to applying either layer in isolation, demonstrating its potential to reduce passenger waiting time and answer more requests, thus promoting the development of more efficient and sustainable transportation systems.


title: The Black Hole Explorer: Operating a Hybrid Observatory

abstract: We present a baseline science operations plan for the Black Hole Explorer (BHEX), a space mission concept aiming to confirm the existence of the predicted sharp ``photon ring" resulting from strongly lensed photon trajectories around black holes, as predicted by general relativity, and to measure its size and shape to determine the black hole's spin. BHEX will co-observe with a ground-based very long baseline interferometric (VLBI) array at high-frequency radio wavelengths, providing unprecedented high resolution with the extension to space that will enable photon ring detection and studies of active galactic nuclei. Science operations require a simultaneous coordination between BHEX and a ground array of large and small radio apertures to provide opportunities for surveys and imaging of radio sources, while coordination with a growing network of optical downlink terminals provides the data rates necessary to build sensitivity on long baselines to space. Here we outline the concept of operations for the hybrid observatory, the available observing modes, the observation planning process, and data delivery to achieve the mission goals and meet mission requirements.


title: Recy-ctronics: Designing Fully Recyclable Electronics With Varied Form Factors

abstract: For today's electronics manufacturing process, the emphasis on stable functionality, durability, and fixed physical forms is designed to ensure long-term usability. However, this focus on robustness and permanence complicates the disassembly and recycling processes, leading to significant environmental repercussions. In this paper, we present three approaches that leverage easily recyclable materials-specifically, polyvinyl alcohol (PVA) and liquid metal (LM)-alongside accessible manufacturing techniques to produce electronic components and systems with versatile form factors. Our work centers on the development of recyclable electronics through three methods: 1) creating sheet electronics by screen printing LM traces on PVA substrates; 2) developing foam-based electronics by immersing mechanically stirred PVA foam into an LM solution; and 3) fabricating recyclable electronic tubes by injecting LM into mold cast PVA tubes, which can then be woven into various structures. To further assess the sustainability of our proposed methods, we conducted a life cycle assessment (LCA) to evaluate the environmental impact of our recyclable electronics in comparison to their conventional counterparts.


title: Automated Molecular Concept Generation and Labeling with Large Language Models

abstract: Artificial intelligence (AI) is significantly transforming scientific research. Explainable AI methods, such as concept-based models (CMs), are promising for driving new scientific discoveries because they make predictions based on meaningful concepts and offer insights into the prediction process. In molecular science, however, explainable CMs are not as common compared to black-box models like Graph Neural Networks (GNNs), primarily due to their requirement for predefined concepts and manual label for each instance, which demand domain knowledge and can be labor-intensive. This paper introduces a novel framework for Automated Molecular Concept (AutoMolCo) generation and labeling. AutoMolCo leverages the knowledge in Large Language Models (LLMs) to automatically generate predictive molecular concepts and label them for each molecule. Such procedures are repeated through iterative interactions with LLMs to refine concepts, enabling simple linear models on the refined concepts to outperform GNNs and LLM in-context learning on several benchmarks. The whole AutoMolCo framework is automated without any human knowledge inputs in either concept generation, labeling, or refinement, thereby surpassing the limitations of extant CMs while maintaining their explainability and allowing easy intervention. Through systematic experiments on MoleculeNet and High-Throughput Experimentation (HTE) datasets, we demonstrate that the AutoMolCo-induced explainable CMs are beneficial and promising for molecular science research.


title: ImageNet3D: Towards General-Purpose Object-Level 3D Understanding

abstract: A vision model with general-purpose object-level 3D understanding should be capable of inferring both 2D (e.g., class name and bounding box) and 3D information (e.g., 3D location and 3D viewpoint) for arbitrary rigid objects in natural images. This is a challenging task, as it involves inferring 3D information from 2D signals and most importantly, generalizing to rigid objects from unseen categories. However, existing datasets with object-level 3D annotations are often limited by the number of categories or the quality of annotations. Models developed on these datasets become specialists for certain categories or domains, and fail to generalize. In this work, we present ImageNet3D, a large dataset for general-purpose object-level 3D understanding. ImageNet3D augments 200 categories from the ImageNet dataset with 2D bounding box, 3D pose, 3D location annotations, and image captions interleaved with 3D information. With the new annotations available in ImageNet3D, we could (i) analyze the object-level 3D awareness of visual foundation models, and (ii) study and develop general-purpose models that infer both 2D and 3D information for arbitrary rigid objects in natural images, and (iii) integrate unified 3D models with large language models for 3D-related reasoning.. We consider two new tasks, probing of object-level 3D awareness and open vocabulary pose estimation, besides standard classification and pose estimation. Experimental results on ImageNet3D demonstrate the potential of our dataset in building vision models with stronger general-purpose object-level 3D understanding.


title: Trainability issues in quantum policy gradients

abstract: This research explores the trainability of Parameterized Quantum circuit-based policies in Reinforcement Learning, an area that has recently seen a surge in empirical exploration. While some studies suggest improved sample complexity using quantum gradient estimation, the efficient trainability of these policies remains an open question. Our findings reveal significant challenges, including standard Barren Plateaus with exponentially small gradients and gradient explosion. These phenomena depend on the type of basis-state partitioning and mapping these partitions onto actions. For a polynomial number of actions, a trainable window can be ensured with a polynomial number of measurements if a contiguous-like partitioning of basis-states is employed. These results are empirically validated in a multi-armed bandit environment.


title: Strain rate controls alignment in growing bacterial monolayers

abstract: Growing monolayers of rod-shaped bacteria exhibit local alignment similar to extensile active nematics. When confined in a channel or growing inward from a ring, the local nematic order of these monolayers changes to a global ordering with cells throughout the monolayer orienting in the same direction. The mechanism behind this phenomenon is so far unclear, as previously proposed mechanisms fail to predict the correct alignment direction in one or more confinement geometries. We present a strain-based model relating net deformation of the growing monolayer to the cell-level deformation resulting from single-cell growth and rotation, producing predictions of cell orientation behavior based on the velocity field in the monolayer. This model correctly predicts the direction of preferential alignment in channel-confined, inward-growing, and unconfined colonies. The model also quantitatively predicts orientational order when the velocity field has no net negative strain rate in any direction. We further test our model in simulations of expanding colonies confined to spherical surfaces. Our model and simulations agree that cells away from the origin cell orient radially relative to the colony's center. Additionally, our model's quantitative prediction of the orientational order agrees with the simulation results in the top half of the sphere but fails in the lower half where there is a net negative strain rate. The success of our model bridges the gap between previous works on cell alignment in disparate confinement geometries and provides insight into the underlying physical effects responsible for large-scale alignment.


title: Shape optimization for maximizing ionic concentration constrained by steady-state Poisson-Nernst-Planck system

abstract: We build a new mathematical model of shape optimization for maximizing ionic concentration governed by the multi-physical coupling steady-state Poisson-Nernst-Planck system. Shape sensitivity analysis is performed to obtain the Eulerian derivative of the cost functional. The Gummel fixed-point method with inverse harmonic averaging technique on exponential coefficient is used to solve efficiently the steady-state Poisson-Nernst-Planck system. Various numerical results using a shape gradient algorithm in 2d and 3d are presented.


title: Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection

abstract: Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performance, but collecting large-scale multimodal data and pre-training multimodal LLMs is challenging. To this end, we propose a Fusion Low Rank Adaptation (FLoRA) technique that efficiently adapts a pre-trained unimodal LLM to consume new, previously unseen modalities via low rank adaptation. For device-directed speech detection, using FLoRA, the multimodal LLM achieves 22% relative reduction in equal error rate (EER) over the text-only approach and attains performance parity with its full fine-tuning (FFT) counterpart while needing to tune only a fraction of its parameters. Furthermore, with the newly introduced adapter dropout, FLoRA is robust to missing data, improving over FFT by 20% lower EER and 56% lower false accept rate. The proposed approach scales well for model sizes from 16M to 3B parameters.


title: Multi-Modal Retrieval For Large Language Model Based Speech Recognition

abstract: Retrieval is a widely adopted approach for improving language models leveraging external information. As the field moves towards multi-modal large language models, it is important to extend the pure text based methods to incorporate other modalities in retrieval as well for applications across the wide spectrum of machine learning tasks and data types. In this work, we propose multi-modal retrieval with two approaches: kNN-LM and cross-attention techniques. We demonstrate the effectiveness of our retrieval approaches empirically by applying them to automatic speech recognition tasks with access to external information. Under this setting, we show that speech-based multi-modal retrieval outperforms text based retrieval, and yields up to 50 % improvement in word error rate over the multi-modal language model baseline. Furthermore, we achieve state-of-the-art recognition results on the Spoken-Squad question answering dataset.


title: A Characterization of backward bounded solutions

abstract: We prove that the collection $\mathcal M_{-\infty}$ of backward bounded solutions for a semilinear evolution equation is the graph of an upper hemicontinuous set-valued function from the low Fourier modes to the higher Fourier modes, which is invariant and contains the global attractor. We also show that there exists a limit $\mathcal M_{\infty}$ of finite dimensional Lipschitz manifolds $\mathcal M_t$ generated by the time $t$-maps ($t>0$) from the flat manifold $\mathcal M_0$ with the Hausdorff distance and we find $\mathcal M_{\infty} \subset \mathcal M_{-\infty}$. No spectral gap conditions are assumed.


title: Applying Machine Learning to Elucidate Ultrafast Demagnetization Dynamics in Ni and Ni80Fe20

abstract: Understanding the correlation between fast and ultrafast demagnetization processes is crucial for elucidating the microscopic mechanisms underlying ultrafast demagnetization, which is pivotal for various applications in spintronics. Initial theoretical models attempted to establish this correlation but faced challenges due to the complex interplay of physical phenomena. To address this, we employed a variety of machine learning methods, including supervised learning regression algorithms and symbolic regression, to analyze limited experimental data and derive meaningful mathematical expressions between demagnetization time and the Gilbert damping factor. The results reveal that polynomial regression and K-nearest neighbors algorithms perform best in predicting demagnetization time. Additionally, sure-independence-screening-and-sparsifying-operator (SISSO) as a symbolic regression method suggested a direct correlation between demagnetization time and damping factor for Ni and Ni80Fe20, indicating spin-flip scattering predominantly influences the ultrafast demagnetization mechanism. The developed models demonstrate promising predictive capabilities, validated against independent experimental data. Comparative analysis between different materials underscores the significant impact of material properties on ultrafast demagnetization behavior. This study underscores the potential of machine learning in unraveling complex physical phenomena and offers valuable insights for future research in ultrafast magnetism.


title: Enhancing Knowledge Retrieval with In-Context Learning and Semantic Search through Generative AI

abstract: Retrieving and extracting knowledge from extensive research documents and large databases presents significant challenges for researchers, students, and professionals in today's information-rich era. Existing retrieval systems, which rely on general-purpose Large Language Models (LLMs), often fail to provide accurate responses to domain-specific inquiries. Additionally, the high cost of pretraining or fine-tuning LLMs for specific domains limits their widespread adoption. To address these limitations, we propose a novel methodology that combines the generative capabilities of LLMs with the fast and accurate retrieval capabilities of vector databases. This advanced retrieval system can efficiently handle both tabular and non-tabular data, understand natural language user queries, and retrieve relevant information without fine-tuning. The developed model, Generative Text Retrieval (GTR), is adaptable to both unstructured and structured data with minor refinement. GTR was evaluated on both manually annotated and public datasets, achieving over 90% accuracy and delivering truthful outputs in 87% of cases. Our model achieved state-of-the-art performance with a Rouge-L F1 score of 0.98 on the MSMARCO dataset. The refined model, Generative Tabular Text Retrieval (GTR-T), demonstrated its efficiency in large database querying, achieving an Execution Accuracy (EX) of 0.82 and an Exact-Set-Match (EM) accuracy of 0.60 on the Spider dataset, using an open-source LLM. These efforts leverage Generative AI and In-Context Learning to enhance human-text interaction and make advanced AI capabilities more accessible. By integrating robust retrieval systems with powerful LLMs, our approach aims to democratize access to sophisticated AI tools, improving the efficiency, accuracy, and scalability of AI-driven information retrieval and database querying.


title: DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformer

abstract: Generic Face Image Quality Assessment (GFIQA) evaluates the perceptual quality of facial images, which is crucial in improving image restoration algorithms and selecting high-quality face images for downstream tasks. We present a novel transformer-based method for GFIQA, which is aided by two unique mechanisms. First, a Dual-Set Degradation Representation Learning (DSL) mechanism uses facial images with both synthetic and real degradations to decouple degradation from content, ensuring generalizability to real-world scenarios. This self-supervised method learns degradation features on a global scale, providing a robust alternative to conventional methods that use local patch information in degradation learning. Second, our transformer leverages facial landmarks to emphasize visually salient parts of a face image in evaluating its perceptual quality. We also introduce a balanced and diverse Comprehensive Generic Face IQA (CGFIQA-40k) dataset of 40K images carefully designed to overcome the biases, in particular the imbalances in skin tone and gender representation, in existing datasets. Extensive analysis and evaluation demonstrate the robustness of our method, marking a significant improvement over prior methods.


title: Search-based versus Sampling-based Robot Motion Planning: A Comparative Study

abstract: Robot motion planning is a challenging domain as it involves dealing with high-dimensional and continuous search space. In past decades, a wide variety of planning algorithms have been developed to tackle this problem, sometimes in isolation without comparing to each other. In this study, we benchmark two such prominent types of algorithms: OMPL's sampling-based RRT-Connect and SMPL's search-based ARA* with motion primitives. To compare these two fundamentally different approaches fairly, we adapt them to ensure the same planning conditions and benchmark them on the same set of planning scenarios. Our findings suggest that sampling-based planners like RRT-Connect show more consistent performance across the board in high-dimensional spaces, whereas search-based planners like ARA* have the capacity to perform significantly better when used with a suitable action-space sampling scheme. Through this study, we hope to showcase the effort required to properly benchmark motion planners from different paradigms thereby contributing to a more nuanced understanding of their capabilities and limitations. The code is available at https://github.com/gsotirchos/benchmarking_planners


title: DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarks

abstract: We present DrivAerNet++, the largest and most comprehensive multimodal dataset for aerodynamic car design. DrivAerNet++ comprises 8,000 diverse car designs modeled with high-fidelity computational fluid dynamics (CFD) simulations. The dataset includes diverse car configurations such as fastback, notchback, and estateback, with different underbody and wheel designs to represent both internal combustion engines and electric vehicles. Each entry in the dataset features detailed 3D meshes, parametric models, aerodynamic coefficients, and extensive flow and surface field data, along with segmented parts for car classification and point cloud data. This dataset supports a wide array of machine learning applications including data-driven design optimization, generative modeling, surrogate model training, CFD simulation acceleration, and geometric classification. With more than 39 TB of publicly available engineering data, DrivAerNet++ fills a significant gap in available resources, providing high-quality, diverse data to enhance model training, promote generalization, and accelerate automotive design processes. Along with rigorous dataset validation, we also provide ML benchmarking results on the task of aerodynamic drag prediction, showcasing the breadth of applications supported by our dataset. This dataset is set to significantly impact automotive design and broader engineering disciplines by fostering innovation and improving the fidelity of aerodynamic evaluations.


title: Time Series Forecasting with Many Predictors

abstract: We propose a novel approach for time series forecasting with many predictors, referred to as the GO-sdPCA, in this paper. The approach employs a variable selection method known as the group orthogonal greedy algorithm and the high-dimensional Akaike information criterion to mitigate the impact of irrelevant predictors. Moreover, a novel technique, called peeling, is used to boost the variable selection procedure so that many factor-relevant predictors can be included in prediction. Finally, the supervised dynamic principal component analysis (sdPCA) method is adopted to account for the dynamic information in factor recovery. In simulation studies, we found that the proposed method adapts well to unknown degrees of sparsity and factor strength, which results in good performance even when the number of relevant predictors is large compared to the sample size. Applying to economic and environmental studies, the proposed method consistently performs well compared to some commonly used benchmarks in one-step-ahead out-sample forecasts.


title: Complex Symplectic Contractions and 3d Mirrors

abstract: We propose magnetic quivers for the complex-symplectic contraction spaces, which are related to implosions and have a natural interpretation in terms of the Moore-Tachikawa category. We use 3-d mirrors to provide computational checks.


title: RobustSAM: Segment Anything Robustly on Degraded Images

abstract: Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images with degraded quality. Addressing this limitation, we propose the Robust Segment Anything Model (RobustSAM), which enhances SAM's performance on low-quality images while preserving its promptability and zero-shot generalization. Our method leverages the pre-trained SAM model with only marginal parameter increments and computational requirements. The additional parameters of RobustSAM can be optimized within 30 hours on eight GPUs, demonstrating its feasibility and practicality for typical research laboratories. We also introduce the Robust-Seg dataset, a collection of 688K image-mask pairs with different degradations designed to train and evaluate our model optimally. Extensive experiments across various segmentation tasks and datasets confirm RobustSAM's superior performance, especially under zero-shot conditions, underscoring its potential for extensive real-world application. Additionally, our method has been shown to effectively improve the performance of SAM-based downstream tasks such as single image dehazing and deblurring.


title: Massive Dirac Fermions and Strong Shubnikov-de Haas Oscillations in Topological Insulator Sm,Fe:Bi2Se3 Single Crystals

abstract: Topological insulators (TIs) are emergent materials with unique band structure, which allow the study of quantum effect in solids, as well as contribute to high performance quantum devices. To achieve the better performance of TI, here we present a co-doping strategy using synergistic rare-earth Sm and transition-metal Fe dopants in Bi2Se3 single crystals, which combine the advantages of both transition metal doped TI (high ferromagnetic ordering temperature and observed QAHE), and rare-earth doped TI (large magnetic moments and significant spin orbit coupling). In the as-grown single crystals, clear evidences of ferromagnetic ordering were observed. The angle resolve photoemission spectroscopy indicate the ferromagnetism opens a 44 meV band gap at surface Dirac point. Moreover, the carrier mobility at 3 K is ~ 7400 cm2/Vs, and we thus observed an ultra-strong Shubnikov-de Haas oscillation in the longitudinal resistivity, as well as the Hall steps in transverse resistivity below 14 T. Our transport and angular resolved photoemission spectroscopy results suggest that the rare-earth and transition metal co-doping in Bi2Se3 system is a promising avenue implement the quantum anomalous Hall effect, as well as harnessing the massive Dirac fermion in electrical devices.


title: On the complexity of 2-bridge link complements

abstract: We reprove a necessary condition for the Sakuma-Weeks triangulation of a 2-bridge link complement to be minimal in terms of the mapping class describing its alternating 4-string braid construction. For the 2-bridge links satisfying this condition we construct explicit angle structures on the Sakuma-Weeks triangulations and compute both multiplicative and additive lower bounds on the complexity of the link complements via volume estimates. These lower bounds are an improvement on existing volume estimates for the 2-bridge links examined.


title: Muharaf: Manuscripts of Handwritten Arabic Dataset for Cursive Text Recognition

abstract: We present the Manuscripts of Handwritten Arabic~(Muharaf) dataset, which is a machine learning dataset consisting of more than 1,600 historic handwritten page images transcribed by experts in archival Arabic. Each document image is accompanied by spatial polygonal coordinates of its text lines as well as basic page elements. This dataset was compiled to advance the state of the art in handwritten text recognition (HTR), not only for Arabic manuscripts but also for cursive text in general. The Muharaf dataset includes diverse handwriting styles and a wide range of document types, including personal letters, diaries, notes, poems, church records, and legal correspondences. In this paper, we describe the data acquisition pipeline, notable dataset features, and statistics. We also provide a preliminary baseline result achieved by training convolutional neural networks using this data.


title: Optimal Convex Cover as Collision-free Space Approximation for Trajectory Generation

abstract: We propose an online iterative algorithm to find a suitable convex cover to under-approximate the free space for autonomous navigation to delineate Safe Flight Corridors (SFC). The convex cover consists of a set of polytopes such that the union of the polytopes represents obstacle-free space, allowing us to find trajectories for robots that lie within the convex cover. In order to find the SFC that facilitates optimal trajectory generation, we iteratively find overlapping polytopes of maximum volumes that include specified waypoints initialized by a geometric or kinematic planner. Constraints at waypoints appear in two alternating stages of a joint optimization problem, which is solved by a method inspired by the Alternating Direction Method of Multipliers (ADMM) with partially distributed variables. We validate the effectiveness of our proposed algorithm using a range of parameterized environments and show its applications for two-stage motion planning.


title: Non-$\mu$-ordinary smooth cyclic covers of $\mathbb{P}^1$

abstract: Given a family of cyclic covers of $\mathbb{P}^1$ and a prime $p$ of good reduction, by [12] the generic Newton polygon (resp. Ekedahl--Oort type) in the family ($\mu$-ordinary) is known. In this paper, we investigate the existence of non-$\mu$-ordinary smooth curves in the family. In particular, under some auxiliary conditions, we show that when $p$ is sufficiently large the complement of the $\mu$-ordinary locus is always non empty, and for $1$-dimensional families with condition on signature type, we obtain a lower bound for the number of non-$\mu$-ordinary smooth curves. In specific examples, for small $m$, the above general statement can be improved, and we establish the non emptiness of all codimension 1 non-$\mu$-ordinary Newton/Ekedahl--Oort strata ({\em almost} $\mu$-ordinary). Our method relies on further study of the extended Hasse-Witt matrix initiated in [12].


title: An effective Deligne's equidistribution theorem

abstract: We prove an Erd\H{o}s--Tur\'an type inequality for compact Lie groups, from which we deduce an effective version of Deligne's equidistribution theorem.


title: Efficient Personalization of Amplification in Hearing Aids via Multi-band Bayesian Machine Learning

abstract: Personalization of the amplification function of hearing aids has been shown to be of benefit to hearing aid users in previous studies. Several machine learning-based personalization approaches have been introduced in the literature. This paper presents a machine learning personalization approach with the advantage of being efficient in its training based on paired comparisons which makes it practical and field deployable. The training efficiency of this approach is the result of treating frequency bands independent of one another and by simultaneously carrying out Bayesian machine learning in each band across all of the frequency bands. Simulation results indicate that this approach leads to an estimated hearing preference function close to the true hearing preference function in fewer number of paired comparisons relative to the previous machine learning approaches. In addition, a clinical experiment conducted on eight subjects with hearing impairment indicate that this training efficient personalization approach provides personalized gain settings which are on average six times more preferred over the standard prescriptive gain settings.


title: Connecting the hexagonal closed packed structure with the cuboidal lattices: A Burgers-Bain type martensitic transformation for a Lennard-Jones solid derived from exact lattice summations

abstract: The diffusionless martensitic phase transition from a hexagonal close-packed (hcp) arrangement to the face-centered close-packed (fcc) and subsequently the body-centered cubic (bcc) lattice is discussed for a Lennard-Jones solid. The associated lattice vectors to construct the underlying bi-lattice for a Burgers-Bain-type of transformation require a minimum of four parameters $(a,\alpha,\beta,\gamma=c/a)$ describing, beside the change in the base lattice parameters $a$ and $c$, the shear force acting on the hexagonal base plane through the parameter $\alpha$, and the sliding force of the middle layer in the original AB hexagonal packing arrangement through the parameter $\beta$. By optimizing the lattice parameters $a$ and $\beta$ for a $(n,m)$-Lennard-Jones potential, we obtain a simple two-dimensional picture for the complete Burgers-Bain-type hcp$\leftrightarrow$fcc$\leftrightarrow$bcc phase transition. From the generalized lattice vectors we were able to construct the corresponding lattice sums in terms of inverse power potentials applying fast converging Bessel function expansions using a Terras decomposition of the Epstein zeta function combined with a Van der Hoff-Benson expansion for the lattice sums. This allows the cohesive energy to be determined to computer precision for a Lennard-Jones solid. For six different combinations of $(n,m)$-Lennard-Jones potentials the energy $(\alpha,\gamma)$ hypersurface was then mapped out and studied in more detail. We show that for a Lennard-Jones model the minimum energy path is found to be a two-step hcp$\rightarrow$fcc$\rightarrow$bcc transition process. The lowest transition state in each case can be regarded as an upper limit to a hypothetical true minimum energy path out of the many possibilities in a hcp$\leftrightarrow$fcc$\leftrightarrow$bcc phase transition.


title: A gas-surface interaction algorithm for discrete velocity methods in predicting rarefied and multi-scale flows II: For CL boundary model

abstract: The discrete velocity method (DVM) for rarefied flows and the unified methods (based on the DVM framework) for flows in all regimes have proven to be effective flow solvers over the past decades and have been successfully extended to other important physical fields. Both DVM and unified methods strive to physically model gas-gas interactions. However, for gas-surface interactions (GSI) at the wall boundary, they have only used the full accommodation boundary until now, which deviates from reality. Moreover, the accommodation degrees of momentum and thermal energy are often different. To overcome this limitation and extend the DVM and unified methods to more realistic boundary conditions, an algorithm for the Cercignani-Lampis (CL) boundary with different accommodation degrees of momentum and thermal energy is proposed and integrated into the DVM framework. A Gaussian distribution with slip velocity, including several undetermined parameters, is designed to describe the reflected distribution function. Once the accommodation coefficients (ACs) are known, these undetermined parameters are solved using the relationship between ACs and reflected macroscopic fluxes. In this paper, the Maxwell model and CLL model are adopted as benchmarks to evaluate the performance of the proposed CL model. Additionally, the current CL boundary for the DVM framework considers generality, accommodating both the recently developed efficient unstructured velocity space and the traditional Cartesian velocity space. Moreover, the proposed CL model allows for calculations of both monatomic gases and diatomic gases with internal degrees of freedom. Finally, by being integrated with the unified gas-kinetic scheme within the DVM framework, the performance of the present CL model is validated through a series of benchmark numerical tests across a wide range of Knudsen numbers.


title: Industrial Language-Image Dataset (ILID): Adapting Vision Foundation Models for Industrial Settings

abstract: In recent years, the upstream of Large Language Models (LLM) has also encouraged the computer vision community to work on substantial multimodal datasets and train models on a scale in a self-/semi-supervised manner, resulting in Vision Foundation Models (VFM), as, e.g., Contrastive Language-Image Pre-training (CLIP). The models generalize well and perform outstandingly on everyday objects or scenes, even on downstream tasks, tasks the model has not been trained on, while the application in specialized domains, as in an industrial context, is still an open research question. Here, fine-tuning the models or transfer learning on domain-specific data is unavoidable when objecting to adequate performance. In this work, we, on the one hand, introduce a pipeline to generate the Industrial Language-Image Dataset (ILID) based on web-crawled data; on the other hand, we demonstrate effective self-supervised transfer learning and discussing downstream tasks after training on the cheaply acquired ILID, which does not necessitate human labeling or intervention. With the proposed approach, we contribute by transferring approaches from state-of-the-art research around foundation models, transfer learning strategies, and applications to the industrial domain.


title: RASPNet: A Benchmark Dataset for Radar Adaptive Signal Processing Applications

abstract: This work presents a large-scale dataset for radar adaptive signal processing (RASP) applications, aimed at supporting the development of data-driven models within the radar community. The dataset, called RASPNet, consists of 100 realistic scenarios compiled over a variety of topographies and land types from across the contiguous United States, designed to reflect a diverse array of real-world environments. Within each scenario, RASPNet consists of 10,000 clutter realizations from an airborne radar setting, which can be utilized for radar algorithm development and evaluation. RASPNet intends to fill a prominent gap in the availability of a large-scale, realistic dataset that standardizes the evaluation of adaptive radar processing techniques. We describe its construction, organization, and several potential applications, which includes a transfer learning example to demonstrate how RASPNet can be leveraged for realistic adaptive radar processing scenarios.


title: TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphs

abstract: Multi-relational temporal graphs are powerful tools for modeling real-world data, capturing the evolving and interconnected nature of entities over time. Recently, many novel models are proposed for ML on such graphs intensifying the need for robust evaluation and standardized benchmark datasets. However, the availability of such resources remains scarce and evaluation faces added complexity due to reproducibility issues in experimental protocols. To address these challenges, we introduce Temporal Graph Benchmark 2.0 (TGB 2.0), a novel benchmarking framework tailored for evaluating methods for predicting future links on Temporal Knowledge Graphs and Temporal Heterogeneous Graphs with a focus on large-scale datasets, extending the Temporal Graph Benchmark. TGB 2.0 facilitates comprehensive evaluations by presenting eight novel datasets spanning five domains with up to 53 million edges. TGB 2.0 datasets are significantly larger than existing datasets in terms of number of nodes, edges, or timestamps. In addition, TGB 2.0 provides a reproducible and realistic evaluation pipeline for multi-relational temporal graphs. Through extensive experimentation, we observe that 1) leveraging edge-type information is crucial to obtain high performance, 2) simple heuristic baselines are often competitive with more complex methods, 3) most methods fail to run on our largest datasets, highlighting the need for research on more scalable methods.


title: GPT-Fabric: Folding and Smoothing Fabric by Leveraging Pre-Trained Foundation Models

abstract: Fabric manipulation has applications in folding blankets, handling patient clothing, and protecting items with covers. It is challenging for robots to perform fabric manipulation since fabrics have infinite-dimensional configuration spaces, complex dynamics, and may be in folded or crumpled configurations with severe self-occlusions. Prior work on robotic fabric manipulation relies either on heavily engineered setups or learning-based approaches that create and train on robot-fabric interaction data. In this paper, we propose GPT-Fabric for the canonical tasks of fabric folding and smoothing, where GPT directly outputs an action informing a robot where to grasp and pull a fabric. We perform extensive experiments in simulation to test GPT-Fabric against prior state of the art methods for folding and smoothing. We obtain comparable or better performance to most methods even without explicitly training on a fabric-specific dataset (i.e., zero-shot manipulation). Furthermore, we apply GPT-Fabric in physical experiments over 12 folding and 10 smoothing rollouts. Our results suggest that GPT-Fabric is a promising approach for high-precision fabric manipulation tasks.


title: Phase-resolving the absorption signatures of water and carbon monoxide in the atmosphere of the ultra-hot Jupiter WASP-121b with GEMINI-S/IGRINS

abstract: Ultra-hot Jupiters are among the best targets for atmospheric characterization at high spectral resolution. Resolving their transmission spectra as a function of orbital phase offers a unique window into the 3D nature of these objects. In this work, we present three transits of the ultra-hot Jupiter WASP-121b observed with Gemini-S/IGRINS. For the first time, we measure the phase-dependent absorption signals of CO and H$_{\text{2}}$O in the atmosphere of an exoplanet, and we find that they are different. While the blueshift of CO increases during the transit, the absorption lines of H$_{\text{2}}$O become less blueshifted with phase, and even show a redshift in the second half of the transit. These measurements reveal the distinct spatial distributions of both molecules across the atmospheres of ultra-hot Jupiters. Also, we find that the H$_{\text{2}}$O signal is absent in the first quarter of the transit, potentially hinting at cloud formation on the evening terminator of WASP-121b. To further interpret the absorption trails of CO and H$_{\text{2}}$O, as well as the Doppler shifts of Fe previously measured with VLT/ESPRESSO, we compare the data to simulated transits of WASP-121b. To this end, we post-processes the outputs of global circulation models with a 3D Monte-Carlo radiative transfer code. Our analysis shows that the atmosphere of WASP-121b is subject to atmospheric drag, as previously suggested by small hotspot offsets inferred from phase-curve observations. Our study highlights the importance of phase-resolved spectroscopy in unravelling the complex atmospheric structure of ultra-hot Jupiters and sets the stage for further investigations into their chemistry and dynamics.


title: Polariton assisted incoherent to coherent excitation energy transfer between colloidal nanocrystal quantum dots

abstract: We explore the dynamics of energy transfer between two nanocrystal quantum dots placed within an optical microcavity. By adjusting the coupling strength between the cavity photon mode and the quantum dots, we have the capacity to fine-tune the effective coupling between the donor and acceptor. Introducing a nonadiabatic parameter, $\gamma$, governed by the coupling to the cavity mode, we demonstrate the system's capability to shift from the overdamped Forster regime ($\gamma \ll 1$) to an underdamped coherent regime ($\gamma \gg 1$). In the latter regime, characterized by swift energy transfer rates, the dynamics are influenced by decoherence times. To illustrate this, we study the exciton energy transfer dynamics between two closely positioned CdSe/CdS core/shell quantum dots with sizes and separations relevant to experimental conditions. Employing an atomistic approach, we calculate the excitonic level arrangement, exciton-phonon interactions, and transition dipole moments of the quantum dots within the microcavity. These parameters are then utilized to define a model Hamiltonian. Subsequently, we apply a generalized non-Markovian quantum Redfield equation to delineate the dynamics within the polaritonic framework.


title: Reinforced Decoder: Towards Training Recurrent Neural Networks for Time Series Forecasting

abstract: Recurrent neural network-based sequence-to-sequence models have been extensively applied for multi-step-ahead time series forecasting. These models typically involve a decoder trained using either its previous forecasts or the actual observed values as the decoder inputs. However, relying on self-generated predictions can lead to the rapid accumulation of errors over multiple steps, while using the actual observations introduces exposure bias as these values are unavailable during the extrapolation stage. In this regard, this study proposes a novel training approach called reinforced decoder, which introduces auxiliary models to generate alternative decoder inputs that remain accessible when extrapolating. Additionally, a reinforcement learning algorithm is utilized to dynamically select the optimal inputs to improve accuracy. Comprehensive experiments demonstrate that our approach outperforms representative training methods over several datasets. Furthermore, the proposed approach also exhibits promising performance when generalized to self-attention-based sequence-to-sequence forecasting models.


title: Bridging Electromagnetic and Gravitational Form Factors: Insights from LFHQCD

abstract: We propose an efficacious approach to derive the generalized parton distributions for the pion and proton, based upon prior knowledge of their respective parton distribution functions (PDFs). Our method leverages on integral representations of the electromagnetic form factors derived from the light-front holographic QCD (LFHQCD) formalism, coupled with PDFs computed from continuum Schwinger functional methods at the hadronic scale. Using these techniques, we calculate gravitational form factors and associated mass distributions for each hadron. Remarkably, our calculations yield results that closely match recent lattice QCD simulations conducted near the physical pion mass. This work not only deepens our understanding of hadronic structure but also highlights the efficacy of the LFHQCD approach in modeling fundamental properties of hadrons.


title: Carbon accounting in the Cloud: a methodology for allocating emissions across data center users

abstract: This paper presents a methodology for allocating energy consumption to multiple users of shared data center machines, infrastructure, and software. Google uses this methodology to provide carbon reporting data for enterprise customers of multiple Google products, including Google Cloud and Workspace. The approach documented here advances the state-of-the-art of large scale Cloud carbon reporting systems. It uses detailed, granular measurement data on machine energy consumption. In addition, it uses physical factors for allocating energy consumption and carbon emissions--preferred by the Greenhouse Gas Protocol's Scope 3 Reporting Standard. Specifically, the approach described here allocates machine energy consumption based on a combination of data center resource reservations and hourly measured resource usage. It also accounts for Google's own internal use of shared software services, reallocating energy use to the users of those shared services. Finally, it uses hourly, location-specific estimates of carbon intensity to precisely measure carbon emissions of users in a global fleet of data centers.


title: A Survey of Video Datasets for Grounded Event Understanding

abstract: While existing video benchmarks largely consider specialized downstream tasks like retrieval or question-answering (QA), contemporary multimodal AI systems must be capable of well-rounded common-sense reasoning akin to human visual understanding. A critical component of human temporal-visual perception is our ability to identify and cognitively model "things happening", or events. Historically, video benchmark tasks have implicitly tested for this ability (e.g., video captioning, in which models describe visual events with natural language), but they do not consider video event understanding as a task in itself. Recent work has begun to explore video analogues to textual event extraction but consists of competing task definitions and datasets limited to highly specific event types. Therefore, while there is a rich domain of event-centric video research spanning the past 10+ years, it is unclear how video event understanding should be framed and what resources we have to study it. In this paper, we survey 105 video datasets that require event understanding capability, consider how they contribute to the study of robust event understanding in video, and assess proposed video event extraction tasks in the context of this body of research. We propose suggestions informed by this survey for dataset curation and task framing, with an emphasis on the uniquely temporal nature of video events and ambiguity in visual content.


title: OpenAnimalTracks: A Dataset for Animal Track Recognition

abstract: Animal habitat surveys play a critical role in preserving the biodiversity of the land. One of the effective ways to gain insights into animal habitats involves identifying animal footprints, which offers valuable information about species distribution, abundance, and behavior. However, due to the scarcity of animal footprint images, there are no well-maintained public datasets, preventing recent advanced techniques in computer vision from being applied to animal tracking. In this paper, we introduce OpenAnimalTracks dataset, the first publicly available labeled dataset designed to facilitate the automated classification and detection of animal footprints. It contains various footprints from 18 wild animal species. Moreover, we build benchmarks for species classification and detection and show the potential of automated footprint identification with representative classifiers and detection models. We find SwinTransformer achieves a promising classification result, reaching 69.41% in terms of the averaged accuracy. Faster-RCNN achieves mAP of 0.295. We hope our dataset paves the way for automated animal tracking techniques, enhancing our ability to protect and manage biodiversity. Our dataset and code are available at https://github.com/dahlian00/OpenAnimalTracks.


title: An Intrinsic Vector Heat Network

abstract: Vector fields are widely used to represent and model flows for many science and engineering applications. This paper introduces a novel neural network architecture for learning tangent vector fields that are intrinsically defined on manifold surfaces embedded in 3D. Previous approaches to learning vector fields on surfaces treat vectors as multi-dimensional scalar fields, using traditional scalar-valued architectures to process channels individually, thus fail to preserve fundamental intrinsic properties of the vector field. The core idea of this work is to introduce a trainable vector heat diffusion module to spatially propagate vector-valued feature data across the surface, which we incorporate into our proposed architecture that consists of vector-valued neurons. Our architecture is invariant to rigid motion of the input, isometric deformation, and choice of local tangent bases, and is robust to discretizations of the surface. We evaluate our Vector Heat Network on triangle meshes, and empirically validate its invariant properties. We also demonstrate the effectiveness of our method on the useful industrial application of quadrilateral mesh generation.


title: SquirrelFS: using the Rust compiler to check file-system crash consistency

abstract: This work introduces a new approach to building crash-safe file systems for persistent memory. We exploit the fact that Rust's typestate pattern allows compile-time enforcement of a specific order of operations. We introduce a novel crash-consistency mechanism, Synchronous Soft Updates, that boils down crash safety to enforcing ordering among updates to file-system metadata. We employ this approach to build SquirrelFS, a new file system with crash-consistency guarantees that are checked at compile time. SquirrelFS avoids the need for separate proofs, instead incorporating correctness guarantees into the typestate itself. Compiling SquirrelFS only takes tens of seconds; successful compilation indicates crash consistency, while an error provides a starting point for fixing the bug. We evaluate SquirrelFS against state of the art file systems such as NOVA and WineFS, and find that SquirrelFS achieves similar or better performance on a wide range of benchmarks and applications.


title: Carbon-Aware End-to-End Data Movement

abstract: The latest trends in the adoption of cloud, edge, and distributed computing, as well as a rise in applying AI/ML workloads, have created a need to measure, monitor, and reduce the carbon emissions of these compute-intensive workloads and the associated communication costs. The data movement over networks has considerable carbon emission that has been neglected due to the difficulty in measuring the carbon footprint of a given end-to-end network path. We present a novel network carbon footprint measuring mechanism and propose three ways in which users can optimize scheduling network-intensive tasks to enable carbon savings through shifting tasks in time, space, and overlay networks based on the geographic carbon intensity.


title: On the genericity of singularities in spacetimes with weakly trapped submanifolds

abstract: We investigate suitable, physically motivated conditions on spacetimes containing certain submanifolds - the so-called {weakly trapped submanifolds} - that ensure, in a set of neighboring metrics with respect to a convenient topology, that the phenomenon of nonspacelike geodesic incompleteness (i.e., the existence of singularities) is generic in a precise technical sense. We obtain two sets of results. First, we use strong Whitney topologies on spaces of Lorentzian metrics on a manifold $M$, in the spirit of Lerner, and obtain that while the set of singular Lorentzian metrics around a fiducial one possessing a weakly trapped submanifold $\Sigma$ is not really generic, it is nevertheless prevalent in a sense we define, and thus still quite ``large'' in this sense. We prove versions of that result both for the case when $\Sigma$ has codimension 2, and for the case of higher codimension. The second set of results explore a similar question, but now for initial data sets containing MOTS. For this case, we use certain well-known infinite dimensional, Hilbert manifold structures on the space of initial data and use abstract functional-analytic methods based on the work of Biliotti, Javaloyes, and Piccione to obtain a true genericity of null geodesic incompleteness around suitable initial data sets containing MOTS.


title: Differentiability of limit shapes in continuous first passage percolation models

abstract: We introduce and study a class of abstract continuous action minimization problems that generalize continuous first and last passage percolation. In this class of models a limit shape exists. Our main result provides a framework under which that limit shape can be shown to be differentiable. We then describe examples of continuous first passage percolation models that fit into this framework. The first example is of a family of Riemannian first passage percolation models and the second is a discrete time model based on Poissonian points.


title: An alternate approach for estimating grain-growth kinetics

abstract: Rate of grain growth, which aides in achieving desired properties in polycrystalline materials, is conventionally estimated by measuring the size of grains and tracking its change in micrographs reflecting the temporal evolution. Techniques adopting this conventional approach demand an absolute distinction between the grains and the interface separating them to yield an accurate result. Edge-detection, segmentation and other deep-learning algorithms are increasingly adopted to expose the network of boundaries and the associated grains precisely. An alternate approach for measuring grain-growth kinetics, that curtails the need for advanced image-processing treatment, is presented in this work. Grain-growth rate in the current technique is ascertained by \textit{counting} the number of triple-( and quadruple-) junctions, and monitoring its change during the microstructural evolution. The shifted focus of this junction-based treatment minimises the significance of a well-defined grain-boundary network, and consequently, the involvement of the sophisticated techniques that expose them. A regression-based object-detection algorithm is extended to realise, and count, the number of junctions in polycrystalline microstructures. By examining the change in the number of junctions with time, the growth rate is subsequently determined.Growth kinetics estimated by the present junction-based approach, across a wide-range of multiphase polycrystalline microstructures, agree convincingly with the outcomes of the conventional treatment.Besides offering a novel technique for grain-growth measurement, the analysis accompanying the current work unravels a trend, compatible with the topological events, in the progressive evolution of the triple-junctions count. The present approach, through its underlying algorithm, provides a promising option for monitoring grain-growth during in-situ investigations.


title: Coralai: Intrinsic Evolution of Embodied Neural Cellular Automata Ecosystems

abstract: This paper presents Coralai, a framework for exploring diverse ecosystems of Neural Cellular Automata (NCA). Organisms in Coralai utilize modular, GPU-accelerated Taichi kernels to interact, enact environmental changes, and evolve through local survival, merging, and mutation operations implemented with HyperNEAT and PyTorch. We provide an exploratory experiment implementing physics inspired by slime mold behavior showcasing the emergence of competition between sessile and mobile organisms, cycles of resource depletion and recovery, and symbiosis between diverse organisms. We conclude by outlining future work to discover simulation parameters through measures of multi-scale complexity and diversity. Code for Coralai is available at https://github.com/aidanbx/coralai , video demos are available at https://www.youtube.com/watch?v=NL8IZQY02-8 .


title: N-fold module factorizations

abstract: Module factorizations with two factors of a regular normal element in a ring are newly introduced by Xiao-Wu Chen. In the paper, we introduce n-fold module factorizations, that is, module factorizations with n factors. First we realize the category of n-fold module factorizations as the module category of a matrix subring. Then we relate n-fold module factorizations with Gorenstein projective components to Gorenstein projective modules over a specific upper triangular matrix ring, leading to the study of triangular equivalences among certain triangulated stable categories. Finally, we explore recollements involving the stable categories of higher-fold module factorizations. Our results generalize the commutative version of n-fold matrix factorizations and the non-commutative version of 2-fold module factorizations.


title: RSEND: Retinex-based Squeeze and Excitation Network with Dark Region Detection for Efficient Low Light Image Enhancement

abstract: Images captured under low-light scenarios often suffer from low quality. Previous CNN-based deep learning methods often involve using Retinex theory. Nevertheless, most of them cannot perform well in more complicated datasets like LOL-v2 while consuming too much computational resources. Besides, some of these methods require sophisticated training at different stages, making the procedure even more time-consuming and tedious. In this paper, we propose a more accurate, concise, and one-stage Retinex theory based framework, RSEND. RSEND first divides the low-light image into the illumination map and reflectance map, then captures the important details in the illumination map and performs light enhancement. After this step, it refines the enhanced gray-scale image and does element-wise matrix multiplication with the reflectance map. By denoising the output it has from the previous step, it obtains the final result. In all the steps, RSEND utilizes Squeeze and Excitation network to better capture the details. Comprehensive quantitative and qualitative experiments show that our Efficient Retinex model significantly outperforms other CNN-based models, achieving a PSNR improvement ranging from 0.44 dB to 4.2 dB in different datasets and even outperforms transformer-based models in the LOL-v2-real dataset.


title: ScaLES: Scalable Latent Exploration Score for Pre-Trained Generative Networks

abstract: We develop Scalable Latent Exploration Score (ScaLES) to mitigate over-exploration in Latent Space Optimization (LSO), a popular method for solving black-box discrete optimization problems. LSO utilizes continuous optimization within the latent space of a Variational Autoencoder (VAE) and is known to be susceptible to over-exploration, which manifests in unrealistic solutions that reduce its practicality. ScaLES is an exact and theoretically motivated method leveraging the trained decoder's approximation of the data distribution. ScaLES can be calculated with any existing decoder, e.g. from a VAE, without additional training, architectural changes, or access to the training data. Our evaluation across five LSO benchmark tasks and three VAE architectures demonstrates that ScaLES enhances the quality of the solutions while maintaining high objective values, leading to improvements over existing solutions. We believe that new avenues to LSO will be opened by ScaLES ability to identify out of distribution areas, differentiability, and computational tractability. Open source code for ScaLES is available at https://github.com/OmerRonen/scales.


title: The inadequacy of the geometric features of MA islands in relating bainite microstructures to composition and processing conditions

abstract: Achieving desired properties in bainite steels with MA islands demands understanding the affect of processing conditions and composition on their size and morphology. Generally, this understanding is gained by studying the change in the size and morphology of the MA islands with composition and the processing conditions. In the present work, around 8500 MA islands dispersed across of approximately 1500 bainite microstructures are investigated to comprehend the influence of composition and heat treatment cycle on the geometric features. The geometric features considered in this study include polygon area metric, compactness and aspect ratio. A thorough statistical analysis of these features across bainite steels of different compositions and processing conditions unravel that, though there are minor changes, no characteristic variation is introduced in the size and morphology of the MA islands. In other words, the distribution of the various forms of MA islands are almost identical in bainite steels of different chemistry and heat treatment, thereby indicating the inadequacy of geometric features in explicating the affect of processing conditions on microstructure.


title: The giant component of excursions sets of spherical Gaussian ensembles: existence, uniqueness, and volume concentration

abstract: We establish the existence and uniqueness of a well-concentrated giant component in the supercritical excursion sets of three important ensembles of spherical Gaussian random fields: Kostlan's ensemble, band-limited ensembles, and the random spherical harmonics. Our main results prescribe quantitative bounds for the volume fluctuations of the giant that are essentially optimal for non-monochromatic ensembles, and suboptimal but still strong for monochromatic ensembles. Our results support the emerging picture that giant components in Gaussian random field excursion sets have similar large-scale statistical properties to giant components in supercritical Bernoulli percolation. The proofs employ novel decoupling inequalities for spherical ensembles which are of independent interest.


title: Energetics of particle-size segregation

abstract: We introduce a continuum framework for the energetics of particle-size segregation in bidisperse granular flows. Building on continuum segregation equations and a recent segregation flux model, the proposed framework offers general analytical expressions to study the physics of granular flows from a mechanical energy perspective. To demonstrate the framework's applicability, we examined the energetics in shear-driven flows. Numerical experiments with varying frictional coefficients and particle-size ratios revealed two distinct phases in the associated energetics with particle segregation and diffusive remixing, and that the potential energy to the kinetic energy ratio in the steady state follows the scaling relationship $\hat{E}^{(s)}_{gp} / \hat{E}^{(s)}_{k} \propto Pe^{-1/2}_{sr}$ for $0.4 \leq Pe_{sr} \leq 300$, the segregation-rheology P\'eclet number. Our findings hint that the bulk segregation-mixing state can be predicted and controlled using $Pe_{sr}$, determined from known system parameters, providing a impactful tool for engineering and geophysical applications.


title: Temporal Planning via Interval Logic Satisfiability for Autonomous Systems

abstract: Many automated planning methods and formulations rely on suitably designed abstractions or simplifications of the constrained dynamics associated with agents to attain computational scalability. We consider formulations of temporal planning where intervals are associated with both action and fluent atoms, and relations between these are given as sentences in Allen's Interval Logic. We propose a notion of planning graphs that can account for complex concurrency relations between actions and fluents as a Constraint Programming (CP) model. We test an implementation of our algorithm on a state-of-the-art framework for CP and compare it with PDDL 2.1 planners that capture plans requiring complex concurrent interactions between agents. We demonstrate our algorithm outperforms existing PDDL 2.1 planners in the case studies. Still, scalability remains challenging when plans must comply with intricate concurrent interactions and the sequencing of actions.


title: Learning Language Structures through Grounding

abstract: Language is highly structured, with syntactic and semantic structures, to some extent, agreed upon by speakers of the same language. With implicit or explicit awareness of such structures, humans can learn and use language efficiently and generalize to sentences that contain unseen words. Motivated by human language learning, in this dissertation, we consider a family of machine learning tasks that aim to learn language structures through grounding. We seek distant supervision from other data sources (i.e., grounds), including but not limited to other modalities (e.g., vision), execution results of programs, and other languages. We demonstrate the potential of this task formulation and advocate for its adoption through three schemes. In Part I, we consider learning syntactic parses through visual grounding. We propose the task of visually grounded grammar induction, present the first models to induce syntactic structures from visually grounded text and speech, and find that the visual grounding signals can help improve the parsing quality over language-only models. As a side contribution, we propose a novel evaluation metric that enables the evaluation of speech parsing without text or automatic speech recognition systems involved. In Part II, we propose two execution-aware methods to map sentences into corresponding semantic structures (i.e., programs), significantly improving compositional generalization and few-shot program synthesis. In Part III, we propose methods that learn language structures from annotations in other languages. Specifically, we propose a method that sets a new state of the art on cross-lingual word alignment. We then leverage the learned word alignments to improve the performance of zero-shot cross-lingual dependency parsing, by proposing a novel substructure-based projection method that preserves structural knowledge learned from the source language.


title: Interpretable MA-island clusters and fingerprints relating bainite microstructures to composition and processing temperature

abstract: Realising the affect of composition and processing condition on bainite microstructures is often challenging, owing to the intricate distribution of the constituent phases. In this work, scanning electron micrographs of non-isothermally transformed bainite, with martensite-austenite (MA) islands, are analysed to relate the microstructures to the composition and quench-stop temperature. The inadequacy of the MA-islands' geometric features, namely aspect ratio, polygon area and compactness, in establishing this relation is made evident from Kullback-Leibler (KL) divergence at the outset. Clustering the bainite microstructures, following a combination of feature extraction and dimensionality reduction, further fails to realise the affect of composition and processing temperature. Deep-learning analysis of the individual MA islands, in contrast to the bainite microstructures, yields interpretable clusters with characteristically distinct size and morphology. These five clusters, referred to as fine- and coarse-dendrite, fine- and coarse-polygon and elongated, are exceptionally discernible and can be adopted to describe any MA island. Characterising the bainite microstructures, based on the distribution of the interpretable MA-island clusters, generates \textit{fingerprints} that sufficiently relates the composition and processing conditions with the microstructures.


title: Frequency-mix Knowledge Distillation for Fake Speech Detection

abstract: In the telephony scenarios, the fake speech detection (FSD) task to combat speech spoofing attacks is challenging. Data augmentation (DA) methods are considered effective means to address the FSD task in telephony scenarios, typically divided into time domain and frequency domain stages. While each has its advantages, both can result in information loss. To tackle this issue, we propose a novel DA method, Frequency-mix (Freqmix), and introduce the Freqmix knowledge distillation (FKD) to enhance model information extraction and generalization abilities. Specifically, we use Freqmix-enhanced data as input for the teacher model, while the student model's input undergoes time-domain DA method. We use a multi-level feature distillation approach to restore information and improve the model's generalization capabilities. Our approach achieves state-of-the-art results on ASVspoof 2021 LA dataset, showing a 31\% improvement over baseline and performs competitively on ASVspoof 2021 DF dataset.


title: New algorithms for sampling and diffusion models

abstract: Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the concept of the reverse diffusion process, widely adopted in diffusion generative models. Additionally, we derive the explicit convergence rate based on the smooth ODE flow. For diffusion generative models and sampling, we establish a {\it dimension-free} particle approximation convergence result. Numerical experiments demonstrate the effectiveness of our method. Notably, unlike the traditional Langevin method, our sampling method does not require any regularity assumptions about the density function of the target distribution. Furthermore, we also apply our method to optimization problems.


title: Graphs of Reduced Words and Some Connections

abstract: The family of graphs of reduced words of a certain subcollection of permutations in the union $\cup_{n\geq 4}\frak{S}_{n}$ of symmetic groups is investigated. The subcollection is characterised by the hook cycle type $(n-2,1,1)$ with consecutive fixed points. A closed formula for counting the vertices of each member of the family is given and the vertex-degree polynomials for the graphs with their generating series is realised. Lastly, some isomorphisms of these graphs with various combinatorial objects are established.


title: Anomalies for conformal nets associated with lattices and $T$-kernels

abstract: Let $L\subseteq \mathbb{R}^{n}$ an even lattice and $T_{L}=\mathbb{R}^{n}/L$ the associated torus. Associated with $L$ we construct $T_{L}$--kernel on a hyperfinite factor type $\mathcal{A}_{L}$, i.e. a monomorphism $T_{L}\to\mathsf{Out}(\mathcal{A}_{L})$, and compute Sutherland's obstruction class in $H^{3}_{\mathrm{Borel}}(T_{L},\mathbb{T})\cong H^{4}(BT_{L} ,\mathbb{Z})$, which is an invariant of the $T_{L}$--kernel and an obstruction to the existence of a twisted crossed product by $T_{L}$. As a Corollary, we obtain that for any $n$-torus $T$ any class in $H^{3}_{\mathrm{Borel}}(T,\mathbb{T})$ arises as an obstruction for a $T$-kernel on the hyperfinite type III${}_{1}$ factor $R$. The construction is an analogue of the construction of Vaughan Jones for finite groups on the hyperfinite type II${}_{1}$ factor but is also motivated by and has applications to conformal nets. Namely, there is an associated local extension $\mathcal{A}_{L}\supseteq \mathcal{A}_{\mathbb{R}^n}$ of conformal nets and the $T_{L}$--kernel corresponds to a family of $T_{L^\ast}$--twisted sectors representations whose anomaly (obstruction) can be identified with the inner product on $L$ seen as a class in $H^{4}(BT_{L},\mathbb{Z})\cong \operatorname{Sym}^{2}(L,\mathbb{Z})$.


title: Mc'Kean's transformation for 3-rd order operators

abstract: We consider a non-self-adjoint third order operator $(y''+py)'+py'+qy$ with 1-periodic coefficients $p,q$. This operator is the L-operator in the Lax pair for the good Boussinesq equation on the circle. In 1981, McKean introduced a transformation that reduces the spectral problem for this operator to a spectral problem for the Hill operator with a potential that depends analytically on the energy. In the present paper we are studying this transformation.


title: Watch the Watcher! Backdoor Attacks on Security-Enhancing Diffusion Models

abstract: Thanks to their remarkable denoising capabilities, diffusion models are increasingly being employed as defensive tools to reinforce the security of other models, notably in purifying adversarial examples and certifying adversarial robustness. However, the security risks of these practices themselves remain largely unexplored, which is highly concerning. To bridge this gap, this work investigates the vulnerabilities of security-enhancing diffusion models. Specifically, we demonstrate that these models are highly susceptible to DIFF2, a simple yet effective backdoor attack, which substantially diminishes the security assurance provided by such models. Essentially, DIFF2 achieves this by integrating a malicious diffusion-sampling process into the diffusion model, guiding inputs embedded with specific triggers toward an adversary-defined distribution while preserving the normal functionality for clean inputs. Our case studies on adversarial purification and robustness certification show that DIFF2 can significantly reduce both post-purification and certified accuracy across benchmark datasets and models, highlighting the potential risks of relying on pre-trained diffusion models as defensive tools. We further explore possible countermeasures, suggesting promising avenues for future research.


title: Delayed phosphate release can highly improve energy efficiency of muscle contraction

abstract: The power stroke of myosin and the release of inorganic phosphate (Pi) are pivotal in the conversion of ATP's chemical energy into mechanical work. Although the precise sequence of these two events remains a subject of debate, it is generally agreed that Pi-release into the solution doesn't occur instantly upon the binding of a myosin to actin. Here, we examine how Pi-release that is not directly coupled with the power stroke affects muscle contraction. Utilizing a cross-scale mechanics model for a sarcomere unit that integrates the chemomechanical cycle of individual myosins, we find that relatively slow Pi-release can markedly improve energy efficiency during muscle contraction in silico. Our analysis leads us to propose that gradual Pi-release may offer a route to finely adjust the bond strength of an attached myosin, thereby indirectly modulating the power stroke to influence muscle performance. When our model is applied to simulate muscle performance in response to rapid jumps in Pi concentrations, we observe asymmetric rates of force alteration, which corroborate previous experimental findings. Indeed, our model's predictions in the current work are largely consistent with experimental data. This research provides crucial insights into the kinetics of Pi-release within the myosin's chemomechanical cycle and its significant regulatory impact on muscle contraction.


title: Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam

abstract: The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most advanced visual model at the time the study was conducted, on the Bachelor in Computer Science section of Brazil's 2021 National Undergraduate Exam (ENADE). By presenting the model with the exam's open and multiple-choice questions in their original image format and allowing for reassessment in response to differing answer keys, we were able to evaluate the model's reasoning and self-reflecting capabilities in a large-scale academic assessment involving textual and visual content. ChatGPT-4 Vision significantly outperformed the average exam participant, positioning itself within the top 10 best score percentile. While it excelled in questions that incorporated visual elements, it also encountered challenges with question interpretation, logical reasoning, and visual acuity. The involvement of an independent expert panel to review cases of disagreement between the model and the answer key revealed some poorly constructed questions containing vague or ambiguous statements, calling attention to the critical need for improved question design in future exams. Our findings suggest that while ChatGPT-4 Vision shows promise in multimodal academic evaluations, human oversight remains crucial for verifying the model's accuracy and ensuring the fairness of high-stakes educational exams. The paper's research materials are publicly available at https://github.com/nabormendonca/gpt-4v-enade-cs-2021.


title: Averaging for random metastable systems

abstract: Random metastability occurs when an externally forced or noisy system possesses more than one state of apparent equilibrium. This work investigates a class of random dynamical systems, arising from perturbing a one-dimensional piecewise smooth expanding map of the interval with two invariant subintervals, each supporting a unique ergodic absolutely continuous invariant measure. Upon perturbation, this invariance is destroyed, allowing trajectories to randomly switch between subintervals. We show that the invariant density of the randomly perturbed system may be approximated by an explicit convex combination of the two initially invariant densities, obtained by averaging. Further, we also identify the limit of the second Oseledets space, or coherent structure, as the perturbation shrinks to zero. Our results are applied to random paired tent maps over ergodic, measure-preserving, and invertible driving systems. Finally, we provide generalisations to systems admitting more than two initially invariant sets.


title: On the fidelity of information retrieval in the black hole final state model with scrambling interactions

abstract: We study the fidelity of information retrieval in the black hole final state model by taking into account the interactions between the collapsing matter and the infalling Hawking radiation inside the event horizon. By utilizing a scrambling unitary operator to model these interactions, our direct calculations suggest that the information is almost lost during the process of black hole evaporation. We then proceed to employ the Yoshida-Kitaev decoding strategy for information retrieval. Although we observe a finite improvement in decoding fidelity, it does not reach unity. This indicates that the issue of unitarity in black hole evaporation may not be fully resolved within the framework of the final state model.


title: Chiral excitonic systems in twisted bilayers from F\"{o}rster coupling and unconventional excitonic Hall effects

abstract: In twisted bilayer semiconductors with arbitrary twisting angles, a chiral excitonic system can arise from the interlayer electron-hole Coulomb exchange interaction (F\"{o}rster coupling) that hybridizes the anisotropic intralayer excitons from individual layers. We present a general framework for the effective exciton Hamiltonian taking into account the electron-hole Coulomb exchange, using twisted homobilayer systems composed of transition metal dichalcogenides or black phosphorus as examples. We demonstrate that such chiral excitonic systems can feature unconventional Hall (Nernst) effects arising from quantum geometric properties characteristic of the layer hybridized wavefunctions under the chiral symmetry, for example, the time-reversal even layer Hall counter flow and the crossed nonlinear dynamical Hall effect, when mechanical and statistical force (temperature or density gradient) drives the exciton flow.


title: Benchmarking Spectral Graph Neural Networks: A Comprehensive Study on Effectiveness and Efficiency

abstract: With the recent advancements in graph neural networks (GNNs), spectral GNNs have received increasing popularity by virtue of their specialty in capturing graph signals in the frequency domain, demonstrating promising capability in specific tasks. However, few systematic studies have been conducted on assessing their spectral characteristics. This emerging family of models also varies in terms of designs and settings, leading to difficulties in comparing their performance and deciding on the suitable model for specific scenarios, especially for large-scale tasks. In this work, we extensively benchmark spectral GNNs with a focus on the frequency perspective. We analyze and categorize over 30 GNNs with 27 corresponding filters. Then, we implement these spectral models under a unified framework with dedicated graph computations and efficient training schemes. Thorough experiments are conducted on the spectral models with inclusive metrics on effectiveness and efficiency, offering practical guidelines on evaluating and selecting spectral GNNs with desirable performance. Our implementation enables application on larger graphs with comparable performance and less overhead, which is available at: https://github.com/gdmnl/Spectral-GNN-Benchmark.


title: Optimizing Byte-level Representation for End-to-end ASR

abstract: We propose a novel approach to optimizing a byte-level representation for end-to-end automatic speech recognition (ASR). Byte-level representation is often used by large scale multilingual ASR systems when the character set of the supported languages is large. The compactness and universality of byte-level representation allow the ASR models to use smaller output vocabularies and therefore, provide more flexibility. UTF-8 is a commonly used byte-level representation for multilingual ASR, but it is not designed to optimize machine learning tasks directly. By using auto-encoder and vector quantization, we show that we can optimize a byte-level representation for ASR and achieve better accuracy. Our proposed framework can incorporate information from different modalities, and provides an error correction mechanism. In an English/Mandarin dictation task, we show that a bilingual ASR model built with this approach can outperform UTF-8 representation by 5% relative in error rate.


title: SAGA: Synthesis Augmentation with Genetic Algorithms for In-Memory Sequence Optimization

abstract: The von-Neumann architecture has a bottleneck which limits the speed at which data can be made available for computation. To combat this problem, novel paradigms for computing are being developed. One such paradigm, known as in-memory computing, interleaves computation with the storage of data within the same circuits. MAGIC, or Memristor Aided Logic, is an approach which uses memory circuits which physically perform computation through write operations to memory. Sequencing these operations is a computationally difficult problem which is directly correlated with the cost of solutions using MAGIC based in-memory computation. SAGA models the execution sequences as a topological sorting problem which makes the optimization well-suited for genetic algorithms. We then detail the formation and implementation of these genetic algorithms and evaluate them over a number of open circuit implementations. The memory-footprint needed for evaluating each of these circuits is decreased by up to 52% from existing, greedy-algorithm-based optimization solutions. Over the 10 benchmark circuits evaluated, these modifications lead to an overall improvement in the efficiency of in-memory circuit evaluation of 128% in the best case and 27.5% on average.


title: Convergence rate of nonlinear delayed McKean-Vlasov SDEs driven by fractional Brownian motions

abstract: In this paper, our main aim is to investigate the strong convergence for a McKean-Vlasov stochastic differential equation with super-linear delay driven by fractional Brownian motion with Hurst exponent $H\in(1/2, 1)$. After giving uniqueness and existence for the exact solution, we analyze the properties including boundedness of moment and propagation of chaos. Besides, we give the Euler-Maruyama (EM) scheme and show that the numerical solution converges strongly to the exact solution. Furthermore, a corresponding numerical example is given to illustrate the theory.


title: Exploring Training on Heterogeneous Data with Mixture of Low-rank Adapters

abstract: Training a unified model to take multiple targets into account is a trend towards artificial general intelligence. However, how to efficiently mitigate the training conflicts among heterogeneous data collected from different domains or tasks remains under-explored. In this study, we explore to leverage Mixture of Low-rank Adapters (MoLA) to mitigate conflicts in heterogeneous data training, which requires to jointly train the multiple low-rank adapters and their shared backbone. Specifically, we introduce two variants of MoLA, namely, MoLA-Grad and MoLA-Router, to respectively handle the target-aware and target-agnostic scenarios during inference. The former uses task identifiers to assign personalized low-rank adapters to each task, disentangling task-specific knowledge towards their adapters, thereby mitigating heterogeneity conflicts. The latter uses a novel Task-wise Decorrelation (TwD) loss to intervene the router to learn oriented weight combinations of adapters to homogeneous tasks, achieving similar effects. We conduct comprehensive experiments to verify the superiority of MoLA over previous state-of-the-art methods and present in-depth analysis on its working mechanism. Source code is available at: https://github.com/MediaBrain-SJTU/MoLA


title: Heterogeneous Federated Learning with Convolutional and Spiking Neural Networks

abstract: Federated learning (FL) has emerged as a promising paradigm for training models on decentralized data while safeguarding data privacy. Most existing FL systems, however, assume that all machine learning models are of the same type, although it becomes more likely that different edge devices adopt different types of AI models, including both conventional analogue artificial neural networks (ANNs) and biologically more plausible spiking neural networks (SNNs). This diversity empowers the efficient handling of specific tasks and requirements, showcasing the adaptability and versatility of edge computing platforms. One main challenge of such heterogeneous FL system lies in effectively aggregating models from the local devices in a privacy-preserving manner. To address the above issue, this work benchmarks FL systems containing both convoluntional neural networks (CNNs) and SNNs by comparing various aggregation approaches, including federated CNNs, federated SNNs, federated CNNs for SNNs, federated SNNs for CNNs, and federated CNNs with SNN fusion. Experimental results demonstrate that the CNN-SNN fusion framework exhibits the best performance among the above settings on the MNIST dataset. Additionally, intriguing phenomena of competitive suppression are noted during the convergence process of multi-model FL.


title: Asymmetrical Siamese Network for Point Clouds Normal Estimation

abstract: In recent years, deep learning-based point cloud normal estimation has made great progress. However, existing methods mainly rely on the PCPNet dataset, leading to overfitting. In addition, the correlation between point clouds with different noise scales remains unexplored, resulting in poor performance in cross-domain scenarios. In this paper, we explore the consistency of intrinsic features learned from clean and noisy point clouds using an Asymmetric Siamese Network architecture. By applying reasonable constraints between features extracted from different branches, we enhance the quality of normal estimation. Moreover, we introduce a novel multi-view normal estimation dataset that includes a larger variety of shapes with different noise levels. Evaluation of existing methods on this new dataset reveals their inability to adapt to different types of shapes, indicating a degree of overfitting. Extensive experiments show that the proposed dataset poses significant challenges for point cloud normal estimation and that our feature constraint mechanism effectively improves upon existing methods and reduces overfitting in current architectures.


title: Privacy-preserving Quantification of Non-IID Degree in Federated Learning

abstract: Federated learning (FL) offers a privacy-preserving approach to machine learning for multiple collaborators without sharing raw data. However, the existence of non-independent and non-identically distributed (non-IID) datasets across different clients presents a significant challenge to FL, leading to a sharp drop in accuracy, reduced efficiency, and hindered implementation. To address the non-IID problem, various methods have been proposed, including clustering and personalized FL frameworks. Nevertheless, to date, a formal quantitative definition of the non-IID degree between different clients' datasets is still missing, hindering the clients from comparing and obtaining an overview of their data distributions with other clients. For the first time, this paper proposes a quantitative definition of the non-IID degree in the federated environment by employing the cumulative distribution function (CDF), called Fully Homomorphic Encryption-based Federated Cumulative Distribution Function (FHE-FCDF). This method utilizes cryptographic primitive fully homomorphic encryption to enable clients to estimate the non-IID degree while ensuring privacy preservation. The experiments conducted on the CIFAR-100 non-IID dataset validate the effectiveness of our proposed method.


title: Interstellar Nitrogen Isotope Ratios: Measurements on tracers of C$^{14}$N and C$^{15}$N

abstract: The nitrogen isotope ratio 14N/15N is a powerful tool to trace Galactic stellar nucleosynthesis and constraining Galactic chemical evolution. Previous observations have found lower 14N/15N ratios in the Galactic center and higher values in the Galactic disk. This is consistent with the inside-out formation scenario of our Milky Way. However, previous studies mostly utilized double isotope ratios also including 12C/13C, which introduces additional uncertainties. Here we therefore present observations of C14N and its rare isotopologue, C15N, toward a sample of star forming regions, measured by the IRAM 30 m and/or the ARO 12 m telescope at $\lambda$ ~3 mm wavelength. For those 35 sources detected in both isotopologues, physical parameters are determined. Furthermore we have obtained nitrogen isotope ratios using the strongest hyperfine components of CN and C15N. For those sources showing small deviations from Local Thermodynamical Equilibrium and/or self-absorption, the weakest hyperfine component, likely free of the latter effect, was used to obtain reliable 14N/15N values. Our measured 14N/15N isotope ratios from C14N and C15N measurements are compatible with those from our earlier measurements of NH3 and 15NH3 (Paper I), i.e., increasing ratios to a Galacticentric distance of ~9 kpc. The unweighted second order polynomial fit yields $\frac{{\rm C^{14}N}}{{\rm C^{15}N}} = (-4.85 \pm 1.89)\;{\rm kpc^{-2}} \times R_{\rm GC}^{2} + (82.11 \pm 31.93) \;{\rm kpc^{-1}} \times R_{\rm GC} - (28.12 \pm 126.62)$. Toward the outer galaxy, the isotope ratio tends to decrease, supporting an earlier finding by H13CN/HC15N. Galactic chemical evolution models are consistent with our measurements of the 14N/15N isotope ratio, i.e. a rising trend from the Galactic center region to approximately 9 kpc, followed by a decreasing trend with increasing $R_{\rm GC}$ toward the outer Galaxy.


title: Explainable AI for Comparative Analysis of Intrusion Detection Models

abstract: Explainable Artificial Intelligence (XAI) has become a widely discussed topic, the related technologies facilitate better understanding of conventional black-box models like Random Forest, Neural Networks and etc. However, domain-specific applications of XAI are still insufficient. To fill this gap, this research analyzes various machine learning models to the tasks of binary and multi-class classification for intrusion detection from network traffic on the same dataset using occlusion sensitivity. The models evaluated include Linear Regression, Logistic Regression, Linear Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Random Forest, Decision Trees, and Multi-Layer Perceptrons (MLP). We trained all models to the accuracy of 90\% on the UNSW-NB15 Dataset. We found that most classifiers leverage only less than three critical features to achieve such accuracies, indicating that effective feature engineering could actually be far more important for intrusion detection than applying complicated models. We also discover that Random Forest provides the best performance in terms of accuracy, time efficiency and robustness. Data and code available at https://github.com/pcwhy/XML-IntrusionDetection.git