title: Interpretable Imitation Learning with Dynamic Causal Relations

abstract: Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret control policies learned by the agent. Difficulties mainly come from two aspects: 1) agents in imitation learning are usually implemented as deep neural networks, which are black-box models and lack interpretability; 2) the latent causal mechanism behind agents' decisions may vary along the trajectory, rather than staying static throughout time steps. To increase transparency and offer better interpretability of the neural agent, we propose to expose its captured knowledge in the form of a directed acyclic causal graph, with nodes being action and state variables and edges denoting the causal relations behind predictions. Furthermore, we design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs. Concretely, we conduct causal discovery from the perspective of Granger causality and propose a self-explainable imitation learning framework, {\method}. The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner. After the model is learned, we can obtain causal relations among states and action variables behind its decisions, exposing policies learned by it. Experimental results on both synthetic and real-world datasets demonstrate the effectiveness of the proposed {\method} in learning the dynamic causal graphs for understanding the decision-making of imitation learning meanwhile maintaining high prediction accuracy.


title: A systematic review of early warning systems in finance

abstract: Early warning systems (EWSs) are critical for forecasting and preventing economic and financial crises. EWSs are designed to provide early warning signs of financial troubles, allowing policymakers and market participants to intervene before a crisis expands. The 2008 financial crisis highlighted the importance of detecting financial distress early and taking preventive measures to mitigate its effects. In this bibliometric review, we look at the research and literature on EWSs in finance. Our methodology included a comprehensive examination of academic databases and a stringent selection procedure, which resulted in the final selection of 616 articles published between 1976 and 2023. Our findings show that more than 90\% of the papers were published after 2006, indicating the growing importance of EWSs in financial research. According to our findings, recent research has shifted toward machine learning techniques, and EWSs are constantly evolving. We discovered that research in this area could be divided into four categories: bankruptcy prediction, banking crisis, currency crisis and emerging markets, and machine learning forecasting. Each cluster offers distinct insights into the approaches and methodologies used for EWSs. To improve predictive accuracy, our review emphasizes the importance of incorporating both macroeconomic and microeconomic data into EWS models. To improve their predictive performance, we recommend more research into incorporating alternative data sources into EWS models, such as social media data, news sentiment analysis, and network analysis.


title: StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrians

abstract: Blind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS's inaccuracy, however, causes them to veer off track, run into unexpected obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via additional hardware installations, enabling precise navigation outdoors remains a challenge. Ironically, many outdoor environments of interest such as downtown districts are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing street cameras for outdoor navigation, and investigate the effectiveness of such an approach. Our resulting system, StreetNav, processes the cameras' video feeds using computer vision and gives BLV pedestrians real-time navigation assistance. Our user evaluations in the COSMOS testbed with eight BLV pedestrians show that StreetNav guides them more precisely than GPS, but its performance is sensitive to lighting conditions and environmental occlusions. We discuss future implications for deploying such systems at scale.


title: From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning

abstract: Large Language Models (LLMs) have achieved remarkable success, where instruction tuning is the critical step in aligning LLMs with user intentions. In this work, we investigate how the instruction tuning adjusts pre-trained models with a focus on intrinsic changes. Specifically, we first develop several local and global explanation methods, including a gradient-based method for input-output attribution, and techniques for interpreting patterns and concepts in self-attention and feed-forward layers. The impact of instruction tuning is then studied by comparing the explanations derived from the pre-trained and instruction-tuned models. This approach provides an internal perspective of the model shifts on a human-comprehensible level. Our findings reveal three significant impacts of instruction tuning: 1) It empowers LLMs to recognize the instruction parts of user prompts, and promotes the response generation constantly conditioned on the instructions. 2) It encourages the self-attention heads to capture more word-word relationships about instruction verbs. 3) It encourages the feed-forward networks to rotate their pre-trained knowledge toward user-oriented tasks. These insights contribute to a more comprehensive understanding of instruction tuning and lay the groundwork for future work that aims at explaining and optimizing LLMs for various applications. Our code and data are publicly available at https://github.com/JacksonWuxs/Interpret_Instruction_Tuning_LLMs.


title: Closed symmetric monoidal structures on the category of graphs

abstract: We show that the category of (reflexive) graphs and graph maps carries exactly two closed symmetric monoidal products: the box product and the categorical product.


title: The Algebra of $S^2$-Upper Triangular Matrices

abstract: Based on work presented in [4], we define $S^2$-Upper Triangular Matrices and $S^2$-Lower Triangular Matrices, two special types of $d\times d(2d-1)$ matrices generalizing Upper and Lower Triangular Matrices, respectively. Then, we show that the property that the determinant of an Upper Triangular Matrix is the product of its diagonal entries is generalized under our construction. Further, we construct the algebra of $S^2$-Upper Triangular Matrices and give conditions for an LU-Decomposition with $S^2$-Lower Triangular and $S^2$-Upper Triangular Matrices, respectively.


title: Characterization of hydrogenated amorphous silicon sensors on polyimide flexible substrate

abstract: Hydrogenated amorphous silicon (a-Si:H) is a material having an intrinsically high radiation hardness that can be deposited on flexible substrates like Polyimide. For these properties a-Si:H can be used for the production of flexible sensors. a-Si:H sensors can be successfully utilized in dosimetry, beam monitoring for particle physics (x-ray, electron, gamma-ray and proton detection) and radiotherapy, radiation flux measurement for space applications (study of solar energetic particles and stellar events) and neutron flux measurements. In this paper we have studied the dosimetric x-ray response of n-i-p diodes deposited on Polyimide. We measured the linearity of the photocurrent response to x-rays versus dose-rate from which we have extracted the dosimetric x-ray sensitivity at various bias voltages. In particular low bias voltage operation has been studied to assess the high energy efficiency of these kind of sensor. A measurement of stability of x-ray response versus time has been shown. The effect of detectors annealing has been studied. Operation under bending at various bending radii is also shown.


title: The Sparsity Roofline: Understanding the Hardware Limits of Sparse Neural Networks

abstract: We introduce the Sparsity Roofline, a visual performance model for evaluating sparsity in neural networks. The Sparsity Roofline jointly models network accuracy, sparsity, and theoretical inference speedup. Our approach does not require implementing and benchmarking optimized kernels, and the theoretical speedup becomes equal to the actual speedup when the corresponding dense and sparse kernels are well-optimized. We achieve this through a novel analytical model for predicting sparse network performance, and validate the predicted speedup using several real-world computer vision architectures pruned across a range of sparsity patterns and degrees. We demonstrate the utility and ease-of-use of our model through two case studies: (1) we show how machine learning researchers can predict the performance of unimplemented or unoptimized block-structured sparsity patterns, and (2) we show how hardware designers can predict the performance implications of new sparsity patterns and sparse data formats in hardware. In both scenarios, the Sparsity Roofline helps performance experts identify sparsity regimes with the highest performance potential.


title: Schwarzschild Modeling of Barred S0 Galaxy NGC 4371

abstract: We apply the barred Schwarzschild method developed by Tahmasebzadeh et al. (2022) to a barred S0 galaxy, NGC 4371, observed by IFU instruments from the TIMER and ATLAS3D projects. We construct the gravitational potential by combining a fixed black hole mass, a spherical dark matter halo, and stellar mass distribution deprojected from $3.6$ $\mu$m S$^4$G image considering an axisymmetric disk and a triaxial bar. We independently modeled kinematic data from TIMER and ATLAS3D. Both models fit the data remarkably well. We find a consistent bar pattern speed from the two sets of models, with $\Omega_{\rm p} = 23.6 \pm 2.8 \hspace{.08cm} \mathrm{km \hspace{.04cm} s^{-1} \hspace{.04cm} kpc^{-1} }$. The dimensionless bar rotation parameter is determined to be $ R_{\rm cor}/R_{\rm bar}=1.9 \pm 0.3$, indicating a slow bar in NGC 4371. Additionally, our model predicts a high amount of dark matter within the bar region ($M_{\rm DM}/ M_{\rm total}$ $\sim 0.51 \pm 0.06$), which, aligned with the predictions of cosmological simulations, indicates that fast bars are generally found in baryon-dominated disks. Based on the best-fitting model, we further decompose the galaxy into multiple 3D orbital structures, including a BP/X bar, a classical bulge, a nuclear disk, and a main disk. The BP/X bar is not perfectly included in the input 3D density model, but BP/X-supporting orbits are picked through the fitting to the kinematic data. This is the first time a real barred galaxy has been modeled utilizing the Schwarzschild method including a 3D bar.


title: Automated Gait Generation For Walking, Soft Robotic Quadrupeds

abstract: Gait generation for soft robots is challenging due to the nonlinear dynamics and high dimensional input spaces of soft actuators. Limitations in soft robotic control and perception force researchers to hand-craft open loop controllers for gait sequences, which is a non-trivial process. Moreover, short soft actuator lifespans and natural variations in actuator behavior limit machine learning techniques to settings that can be learned on the same time scales as robot deployment. Lastly, simulation is not always possible, due to heterogeneity and nonlinearity in soft robotic materials and their dynamics change due to wear. We present a sample-efficient, simulation free, method for self-generating soft robot gaits, using very minimal computation. This technique is demonstrated on a motorized soft robotic quadruped that walks using four legs constructed from 16 "handed shearing auxetic" (HSA) actuators. To manage the dimension of the search space, gaits are composed of two sequential sets of leg motions selected from 7 possible primitives. Pairs of primitives are executed on one leg at a time; we then select the best-performing pair to execute while moving on to subsequent legs. This method -- which uses no simulation, sophisticated computation, or user input -- consistently generates good translation and rotation gaits in as low as 4 minutes of hardware experimentation, outperforming hand-crafted gaits. This is the first demonstration of completely autonomous gait generation in a soft robot.


title: Microscopic Insights into London Penetration Depth: Application to CeCoIn$^{}_{5}$

abstract: We propose a comprehensive theoretical formulation of magnetic penetration depth, $\lambda(T)$, based on the microscopic calculations for a general superconducting gap symmetry. Our findings admit the significant role of band structure and Fermi surface topology together with the symmetry of superconducting order parameter. We employ our findings pertaining to the heavy-fermion superconductor CeCoIn$_5$ to explore both local and non-local behaviors in response to an external magnetic field across varying temperatures. Our calculations in the low-temperature regime offer compelling macroscopic evidence of the nodal character within the superconducting state with $d_{x^2-y^2}$ symmetry. Furthermore, our findings align with the characteristics of London-type superconductivity, holding significant implications for upcoming experiments.


title: Self-Supervised Open-Ended Classification with Small Visual Language Models

abstract: We present Self-Context Adaptation (SeCAt), a self-supervised approach that unlocks few-shot abilities for open-ended classification with small visual language models. Our approach imitates image captions in a self-supervised way based on clustering a large pool of images followed by assigning semantically-unrelated names to clusters. By doing so, we construct a training signal consisting of interleaved sequences of image and pseudocaption pairs and a query image, which we denote as the 'self-context' sequence. Based on this signal the model is trained to produce the right pseudo-caption. We demonstrate the performance and flexibility of SeCAt on several multimodal few-shot datasets, spanning various granularities. By using models with approximately 1B parameters we outperform the few-shot abilities of much larger models, such as Frozen and FROMAGe. SeCAt opens new possibilities for research and applications in open-ended few-shot learning that otherwise requires access to large or proprietary models.


title: Atomically resolved phase coexistence in VO2 thin films

abstract: Concurrent structural and electronic transformations in VO2 thin films are of twofold importance: enabling fine-tuning of the emergent electrical properties in functional devices, yet creating an intricate interfacial domain structure of transitional phases. Despite the importance of understanding the structure of VO2 thin films, a detailed real space atomic structure analysis in which also the oxygen atomic columns are resolved is lacking. Moreover, intermediate atomic structures have remained elusive due to the lack of robust atomically resolved quantitative analysis. Here, we directly resolve both V and O atomic columns and discover the presence of the strain-stabilized intermediate monoclinic (M2) phase nanolayers (less than 2 nm thick) in epitaxially grown VO2 films on a TiO2 (001) substrate, where the dominant part of VO2 undergoes a transition from the tetragonal (rutile) phase to the monoclinic M1 phase. We unfold the crucial role of imaging the spatial configurations of the oxygen anions (in addition to V cations) utilizing atomic-resolution electron microscopy. Our approach sets a direct pathway to unravel the structural transitions in wide range of correlated oxides, offering substantial implications for e.g. optoelectronics and ferroelectrics.


title: On (naturally) semifull and (semi)separable semifunctors

abstract: The notion of semifunctor between categories, due to S. Hayashi (1985), is defined as a functor that does not necessarily preserve identities. In this paper we study how several properties of functors, such as fullness, full faithfulness, separability, natural fullness, can be formulated for semifunctors. Since a full semifunctor is actually a functor, we are led to introduce a notion of semifullness (and then semifull faithfulness) for semifunctors. In order to show that these conditions can be derived from requirements on the hom-set components associated with a semifunctor, we look at "semisplitting properties" for seminatural transformations and we investigate the corresponding properties for morphisms whose source or target is the image of a semifunctor. We define the notion of naturally semifull semifunctor and we characterize natural semifullness for semifunctors that are part of a semiadjunction in terms of semisplitting conditions for the unit and counit attached to the semiadjunction. We study the behavior of semifunctors with respect to (semi)separability and we prove Rafael-type Theorems for (semi)separable semifunctors and a Maschke-type Theorem for separable semifunctors. We provide examples of semifunctors on which we test the properties considered so far.


title: Black-box Attacks on Image Activity Prediction and its Natural Language Explanations

abstract: Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and visual representations. Visual XAI methods have been shown to be vulnerable to white-box and gray-box adversarial attacks, with an attacker having full or partial knowledge of and access to the target system. As the vulnerabilities of multimodal XAI models have not been examined, in this paper we assess for the first time the robustness to black-box attacks of the natural language explanations generated by a self-rationalizing image-based activity recognition model. We generate unrestricted, spatially variant perturbations that disrupt the association between the predictions and the corresponding explanations to mislead the model into generating unfaithful explanations. We show that we can create adversarial images that manipulate the explanations of an activity recognition model by having access only to its final output.


title: Exploring SAM Ablations for Enhancing Medical Segmentation in Radiology and Pathology

abstract: Medical imaging plays a critical role in the diagnosis and treatment planning of various medical conditions, with radiology and pathology heavily reliant on precise image segmentation. The Segment Anything Model (SAM) has emerged as a promising framework for addressing segmentation challenges across different domains. In this white paper, we delve into SAM, breaking down its fundamental components and uncovering the intricate interactions between them. We also explore the fine-tuning of SAM and assess its profound impact on the accuracy and reliability of segmentation results, focusing on applications in radiology (specifically, brain tumor segmentation) and pathology (specifically, breast cancer segmentation). Through a series of carefully designed experiments, we analyze SAM's potential application in the field of medical imaging. We aim to bridge the gap between advanced segmentation techniques and the demanding requirements of healthcare, shedding light on SAM's transformative capabilities.


title: Unveiling the Unborn: Advancing Fetal Health Classification through Machine Learning

abstract: Fetal health classification is a critical task in obstetrics, enabling early identification and management of potential health problems. However, it remains challenging due to data complexity and limited labeled samples. This research paper presents a novel machine-learning approach for fetal health classification, leveraging a LightGBM classifier trained on a comprehensive dataset. The proposed model achieves an impressive accuracy of 98.31% on a test set. Our findings demonstrate the potential of machine learning in enhancing fetal health classification, offering a more objective and accurate assessment. Notably, our approach combines various features, such as fetal heart rate, uterine contractions, and maternal blood pressure, to provide a comprehensive evaluation. This methodology holds promise for improving early detection and treatment of fetal health issues, ensuring better outcomes for both mothers and babies. Beyond the high accuracy achieved, the novelty of our approach lies in its comprehensive feature selection and assessment methodology. By incorporating multiple data points, our model offers a more holistic and reliable evaluation compared to traditional methods. This research has significant implications in the field of obstetrics, paving the way for advancements in early detection and intervention of fetal health concerns. Future work involves validating the model on a larger dataset and developing a clinical application. Ultimately, we anticipate that our research will revolutionize the assessment and management of fetal health, contributing to improved healthcare outcomes for expectant mothers and their babies.


title: Intermediate Gradient Methods with Relative Inexactness

abstract: This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More precisely, we assume that an additive error in the gradient is proportional to the gradient norm, rather than being globally bounded by some small quantity. We propose a novel analysis of the accelerated gradient method under relative inexactness and strong convexity and improve the bound on the maximum admissible error that preserves the linear convergence of the algorithm. In other words, we analyze how robust is the accelerated gradient method to the relative inexactness of the gradient information. Moreover, based on the Performance Estimation Problem (PEP) technique, we show that the obtained result is optimal for the family of accelerated algorithms we consider. Motivated by the existing intermediate methods with absolute error, i.e., the methods with convergence rates that interpolate between slower but more robust non-accelerated algorithms and faster, but less robust accelerated algorithms, we propose an adaptive variant of the intermediate gradient method with relative error in the gradient.


title: Precision Rydberg State Spectroscopy with Slow Electrons and Proton Radius Puzzle

abstract: The so-called proton radius puzzle (the current discrepancy of proton radii determined from spectroscopic measurements in ordinary versus muonic hydrogen) could be addressed via an accurate measurement of the Rydberg constant, because the proton radius and the Rydberg constant values are linked through high-precision optical spectroscopy. We argue that, with manageable additional experimental effort, it might be possible to improve circular Rydberg state spectroscopy, potentially leading to an important contribution to the clarification of the puzzle. Our proposal involves circular and near-circular Rydberg states of hydrogen with principal quantum number around $n=18$, whose classical velocity on a Bohr orbit is slower than that of the fastest macroscopic man-made object, the Parker Solar Probe. We obtain improved estimates for the quality factor of pertinent transitions, and illustrate a few recent improvements in instrumentation which facilitate pertinent experiments.


title: Analytical Modeling of Parameter Imbalance in Permanent Magnet Synchronous Machines

abstract: This paper presents a systematic and comprehensive analysis of the impact of parameter imbalance in permanent magnet synchronous machines. Analytical models that reveal the effects of imbalance are obtained for each parameter. Thereafter, the models are verified for accuracy by comparison with complex simulations that closely represent true machine behavior. Such models may be utilized for developing (general) algorithms for detection, learning and mitigation of the negative effects of parameter imbalance including current (and thus torque) pulsations during real-time operation.


title: Smoothing Mixed Traffic with Robust Data-driven Predictive Control for Connected and Autonomous Vehicles

abstract: The recently developed DeeP-LCC (Data-EnablEd Predictive Leading Cruise Control) method has shown promising performance for data-driven predictive control of Connected and Autonomous Vehicles (CAVs) in mixed traffic. However, its simplistic zero assumption of the future velocity errors for the head vehicle may pose safety concerns and limit its performance of smoothing traffic flow. In this paper, we propose a robust DeeP-LCC method to control CAVs in mixed traffic with enhanced safety performance. In particular, we first present a robust formulation that enforces a safety constraint for a range of potential velocity error trajectories, and then estimate all potential velocity errors based on the past data from the head vehicle. We also provide efficient computational approaches to solve the robust optimization for online predictive control. Nonlinear traffic simulations show that our robust DeeP-LCC can provide better traffic efficiency and stronger safety performance while requiring less offline data.


title: Exploring Benchmarks for Self-Driving Labs using Color Matching

abstract: Self Driving Labs (SDLs) that combine automation of experimental procedures with autonomous decision making are gaining popularity as a means of increasing the throughput of scientific workflows. The task of identifying quantities of supplied colored pigments that match a target color, the color matching problem, provides a simple and flexible SDL test case, as it requires experiment proposal, sample creation, and sample analysis, three common components in autonomous discovery applications. We present a robotic solution to the color matching problem that allows for fully autonomous execution of a color matching protocol. Our solution leverages the WEI science factory platform to enable portability across different robotic hardware, the use of alternative optimization methods for continuous refinement, and automated publication of results for experiment tracking and post-hoc analysis.


title: Nonparametric active learning for cost-sensitive classification

abstract: Cost-sensitive learning is a common type of machine learning problem where different errors of prediction incur different costs. In this paper, we design a generic nonparametric active learning algorithm for cost-sensitive classification. Based on the construction of confidence bounds for the expected prediction cost functions of each label, our algorithm sequentially selects the most informative vector points. Then it interacts with them by only querying the costs of prediction that could be the smallest. We prove that our algorithm attains optimal rate of convergence in terms of the number of interactions with the feature vector space. Furthermore, in terms of a general version of Tsybakov's noise assumption, the gain over the corresponding passive learning is explicitly characterized by the probability-mass of the boundary decision. Additionally, we prove the near-optimality of obtained upper bounds by providing matching (up to logarithmic factor) lower bounds.


title: Structure of quasiconvex virtual joins

abstract: Let $G$ be a relatively hyperbolic group and let $Q$ and $R$ be relatively quasiconvex subgroups. It is known that there are many pairs of finite index subgroups $Q' \leqslant_f Q$ and $R' \leqslant_f R$ such that the subgroup join $\langle Q', R' \rangle$ is also relatively quasiconvex, given suitable assumptions on the profinite topology of $G$. We show that the intersections of such joins with maximal parabolic subgroups of $G$ are themselves joins of intersections of the factor subgroups $Q'$ and $R'$ with maximal parabolic subgroups of $G$. As a consequence, we show that quasiconvex subgroups whose parabolic subgroups are almost compatible have finite index subgroups whose parabolic subgroups are compatible, and provide a combination theorem for such subgroups.


title: Formal Probabilistic Methods for Combinatorial Structures using the Lov\'asz Local Lemma

abstract: Formalised libraries of combinatorial mathematics have rapidly expanded over the last five years, but few use one of the most important tools: probability. How can often intuitive probabilistic arguments on the existence of combinatorial structures, such as hypergraphs, be translated into a formal text? We present a modular framework using locales in Isabelle/HOL to formalise such probabilistic proofs, including the basic existence method and first formalisation of the Lov\'asz local lemma, a fundamental result in probability. The formalisation focuses on general, reusable formal probabilistic lemmas for combinatorial structures, and highlights several notable gaps in typical intuitive probabilistic reasoning on paper. The applicability of the techniques is demonstrated through the formalisation of several classic lemmas on the existence of hypergraphs with certain colourings.


title: The CSP Dichotomy, the Axiom of Choice, and Cyclic Polymorphisms

abstract: We study Constraint Satisfaction Problems (CSPs) in an infinite context. We show that the dichotomy between easy and hard problems -- established already in the finite case -- presents itself as the strength of the corresponding De Bruijin-Erd\H{o}s-type compactness theorem over ZF. More precisely, if $\mathcal{D}$ is a structure, let $K_\mathcal{D}$ stand for the following statement: for every structure $\mathcal{X}$ if every finite substructure of $\mathcal{X}$ admits a solution to $\mathcal{D}$, then so does $\mathcal{X}$. We prove that if $\mathcal{D}$ admits no cyclic polymorphism, and thus it is NP-complete by the CSP Dichotomy Theorem, then $K_\mathcal{D}$ is equivalent to the Boolean Prime Ideal Theorem (BPI) over ZF. Conversely, we also show that if $\mathcal{D}$ admits a cyclic polymorphism, and thus it is in P, then $K_\mathcal{D}$ is strictly weaker than BPI.


title: Quantum spin Hall states in the lateral heteromonolayers of WTe2-MoTe2

abstract: We used density functional theory to investigate the lateral heteromonolayers of WTe2 and MoTe2. We confirmed that topologically nontrivial and trivial phases are energetically favored for the WTe2 and MoTe2 monolayers, taken out of bulk Td-WTe2 and 2H-MoTe2, respectively. We considered heteromonolayers consisting of these stable building blocks. In the Td-WTe2 and 2H-MoTe2 heteromonolayers with the interfaces oriented perpendicular to the dimer chains of W atoms in Td-WTe2 (y direction), two pairs of helical (quantum spin Hall [QSH]) states, one at each interface, connect the valence and conduction bands. The strain induced by the large lattice mismatch of the two materials in the y direction widens the band gap of the QSH insulator of the Td-WTe2 monolayer and is essential for electronic applications. Furthermore, one-dimensional channels embedded in the layer can help avoid chemical degradation from the edges and facilitate the densification of conducting channels. For the heteromonolayer with interfaces in the x direction, the difference in atomic structure between the two interfaces due to low symmetry creates an energy difference between two helical states and a potential gradient in the wide band gap 2H-MoTe2 region, resulting in various interface localized bands.


title: Enhancing Efficiency and Privacy in Memory-Based Malware Classification through Feature Selection

abstract: Malware poses a significant security risk to individuals, organizations, and critical infrastructure by compromising systems and data. Leveraging memory dumps that offer snapshots of computer memory can aid the analysis and detection of malicious content, including malware. To improve the efficacy and address privacy concerns in malware classification systems, feature selection can play a critical role as it is capable of identifying the most relevant features, thus, minimizing the amount of data fed to classifiers. In this study, we employ three feature selection approaches to identify significant features from memory content and use them with a diverse set of classifiers to enhance the performance and privacy of the classification task. Comprehensive experiments are conducted across three levels of malware classification tasks: i) binary-level benign or malware classification, ii) malware type classification (including Trojan horse, ransomware, and spyware), and iii) malware family classification within each family (with varying numbers of classes). Results demonstrate that the feature selection strategy, incorporating mutual information and other methods, enhances classifier performance for all tasks. Notably, selecting only 25\% and 50\% of input features using Mutual Information and then employing the Random Forest classifier yields the best results. Our findings reinforce the importance of feature selection for malware classification and provide valuable insights for identifying appropriate approaches. By advancing the effectiveness and privacy of malware classification systems, this research contributes to safeguarding against security threats posed by malicious software.


title: Assessing the Generalizability of Deep Neural Networks-Based Models for Black Skin Lesions

abstract: Melanoma is the most severe type of skin cancer due to its ability to cause metastasis. It is more common in black people, often affecting acral regions: palms, soles, and nails. Deep neural networks have shown tremendous potential for improving clinical care and skin cancer diagnosis. Nevertheless, prevailing studies predominantly rely on datasets of white skin tones, neglecting to report diagnostic outcomes for diverse patient skin tones. In this work, we evaluate supervised and self-supervised models in skin lesion images extracted from acral regions commonly observed in black individuals. Also, we carefully curate a dataset containing skin lesions in acral regions and assess the datasets concerning the Fitzpatrick scale to verify performance on black skin. Our results expose the poor generalizability of these models, revealing their favorable performance for lesions on white skin. Neglecting to create diverse datasets, which necessitates the development of specialized models, is unacceptable. Deep neural networks have great potential to improve diagnosis, particularly for populations with limited access to dermatology. However, including black skin lesions is necessary to ensure these populations can access the benefits of inclusive technology.


title: Learning Informative Latent Representation for Quantum State Tomography

abstract: Quantum state tomography (QST) is the process of reconstructing the complete state of a quantum system (mathematically described as a density matrix) through a series of different measurements. These measurements are performed on a number of identical copies of the quantum system, with outcomes gathered as frequencies. QST aims to recover the density matrix and the corresponding properties of the quantum state from the measured frequencies. Although an informationally complete set of measurements can specify quantum state accurately in an ideal scenario with a large number of identical copies, both measurements and identical copies are restricted and imperfect in practical scenarios, making QST highly ill-posed. The conventional QST methods usually assume adequate or accurate measured frequencies or rely on manually designed regularizers to handle the ill-posed reconstruction problem, suffering from limited applications in realistic scenarios. Recent advances in deep neural networks (DNNs) led to the emergence of deep learning (DL) in QST. However, existing DL-based QST approaches often employ generic DNN models that are not optimized for imperfect conditions of QST. In this paper, we propose a transformer-based autoencoder architecture tailored for QST with imperfect measurement data. Our method leverages a transformer-based encoder to extract an informative latent representation (ILR) from imperfect measurement data and employs a decoder to predict the quantum states based on the ILR. We anticipate that the high-dimensional ILR will capture more comprehensive information about quantum states. To achieve this, we conduct pre-training of the encoder using a pretext task that involves reconstructing high-quality frequencies from measured frequencies. Extensive simulations and experiments demonstrate the remarkable ability of the ILR in dealing with imperfect measurement data in QST.


title: Finite element analysis of a generalized Robin boundary value problem in curved domains based on the extension method

abstract: A theoretical analysis of the finite element method for a generalized Robin boundary value problem, which involves a second-order differential operator on the boundary, is presented. If $\Omega$ is a general smooth domain with a curved boundary, we need to introduce an approximate domain $\Omega_h$ and to address issues owing to the domain perturbation $\Omega \neq \Omega_h$. In contrast to the transformation approach used in existing studies, we employ the extension approach, which is easier to handle in practical computation, in order to construct a numerical scheme. Assuming that approximate domains and function spaces are given by isoparametric finite elements of order $k$, we prove the optimal rate of convergence in the $H^1$- and $L^2$-norms. A numerical example is given for the piecewise linear case $k = 1$.


title: Scalar-Graviton Amplitudes and Celestial Holography

abstract: We compute scattering amplitudes involving one massive scalar and two, three, or four gravitons. We show that when the conformal dimension of the massive scalar is set to zero, the resulting celestial correlators depend {\it only} on the coordinates of the gravitons. Such correlators of gravitons are well-defined and do not suffer from divergences associated with the Mellin transform of usual graviton amplitudes. Moreover, they are non-distributional and take the form of standard CFT correlators. We show that they are consistent with the usual OPEs but the statement of the soft theorem is modified.


title: Minimal special degenerations and duality

abstract: This paper includes the classification, in a simple Lie algebra, of the singularities of Slodowy slices between special nilpotent orbits that are adjacent in the partial order on nilpotent orbits. The irreducible components of most singularities are (up to normalization) either a simple surface singularity or the closure of a minimal special nilpotent orbit in a smaller rank Lie algebra. Besides those cases, there are some exceptional cases that arise as certain quotients of the closure of a minimal orbit in types $A_2$ and $D_n$. We also consider the action on the slice of the fundamental group of the smaller orbit. With this action, we observe that under Lusztig-Spaltenstein duality, in most cases, a simple surface singularity is interchanged with the closure of a minimal special orbit of Langlands dual type (or a cover of it with action). This empirical observation generalizes an observation of Kraft and Procesi in type $A_n$, where all nilpotent orbits are special. We also resolve a conjecture of Lusztig that concerns the intersection cohomology of slices between special nilpotent orbits.


title: Mapping of Internet "Coastlines" via Large Scale Anonymized Network Source Correlations

abstract: Expanding the scientific tools available to protect computer networks can be aided by a deeper understanding of the underlying statistical distributions of network traffic and their potential geometric interpretations. Analyses of large scale network observations provide a unique window into studying those underlying statistics. Newly developed GraphBLAS hypersparse matrices and D4M associative array technologies enable the efficient anonymized analysis of network traffic on the scale of trillions of events. This work analyzes over 100,000,000,000 anonymized packets from the largest Internet telescope (CAIDA) and over 10,000,000 anonymized sources from the largest commercial honeyfarm (GreyNoise). Neither CAIDA nor GreyNoise actively emit Internet traffic and provide distinct observations of unsolicited Internet traffic (primarily botnets and scanners). Analysis of these observations confirms the previously observed Cauchy-like distributions describing temporal correlations between Internet sources. The Gull lighthouse problem is a well-known geometric characterization of the standard Cauchy distribution and motivates a potential geometric interpretation for Internet observations. This work generalizes the Gull lighthouse problem to accommodate larger classes of coastlines, deriving a closed-form solution for the resulting probability distributions, stating and examining the inverse problem of identifying an appropriate coastline given a continuous probability distribution, identifying a geometric heuristic for solving this problem computationally, and applying that heuristic to examine the temporal geometry of different subsets of network observations. Application of this method to the CAIDA and GreyNoise data reveals a several orders of magnitude difference between known benign and other traffic which can lead to potentially novel ways to protect networks.


title: Accuracy Certificates for Convex Minimization with Inexact Oracle

abstract: Accuracy certificates for convex minimization problems allow for online verification of the accuracy of approximate solutions and provide a theoretically valid online stopping criterion. When solving the Lagrange dual problem, accuracy certificates produce a simple way to recover an approximate primal solution and estimate its accuracy. In this paper, we generalize accuracy certificates for the setting of inexact first-order oracle, including the setting of primal and Lagrange dual pair of problems. We further propose an explicit way to construct accuracy certificates for a large class of cutting plane methods based on polytopes. As a by-product, we show that the considered cutting plane methods can be efficiently used with a noisy oracle even thought they were originally designed to be equipped with an exact oracle. Finally, we illustrate the work of the proposed certificates in the numerical experiments highlighting that our certificates provide a tight upper bound on the objective residual.


title: A New Measurement of the Mean Transmitted Flux in the Lyman-alpha and Lyman-beta Forest

abstract: We present new measurements of the mean transmitted flux in the hydrogen Ly$\rm \alpha$ and a relative transmitted flux measurement in Ly$\rm \beta$ using 27,008 quasar spectra from the Fourteenth Data Release (DR14) of the Extended Baryon Oscillation Spectroscopic Survey (eBOSS). Individual spectra are first combined into 16 composites with mean redshifts in the range of $2.8<z<4.9$. We then apply Markov Chain Monte Carlo (MCMC) inference to produce a piecewise fit of the effective $\tau_{\rm{Ly\alpha}}$ (corrected for metal lines and optically thick absorption) assuming a spline point distribution. We also perform a relative $\Delta \tau_{\rm{Ly\beta}}$ measurement with the same data set, finding $\Delta \tau_{\rm{Ly\beta}}<0.35$ at $z<4.8$. The 6-8 $\%$ precision measurements in the rest frame 1075-1150 {\AA} at $\it{z} \ < \rm{4.0}$ and 10-12 $\%$ precision measurements in the same region at $\it{z} \ > \rm{4.0}$ on $\tau_{\rm{Ly\alpha}}$, and our determinations of $\Delta \tau_{\rm{Ly\beta}}$, are dominated by systematic errors, likely arising from bias and uncertainties in estimates of the quasar continuum. Our $\tau_{\rm{Ly\alpha}}$ values show a smooth increase by a factor of 5 over the redshift range $z=2.4-4.4$.


title: Reinforcement learning adaptive fuzzy controller for lighting systems: application to aircraft cabin

abstract: The lighting requirements are subjective and one light setting cannot work for all. However, there is little work on developing smart lighting algorithms that can adapt to user preferences. To address this gap, this paper uses fuzzy logic and reinforcement learning to develop an adaptive lighting algorithm. In particular, we develop a baseline fuzzy inference system (FIS) using the domain knowledge. We use the existing literature to create a FIS that generates lighting setting recommendations based on environmental conditions i.e. daily glare index, and user information including age, activity, and chronotype. Through a feedback mechanism, the user interacts with the algorithm, correcting the algorithm output to their preferences. We interpret these corrections as rewards to a Q-learning agent, which tunes the FIS parameters online to match the user preferences. We implement the algorithm in an aircraft cabin mockup and conduct an extensive user study to evaluate the effectiveness of the algorithm and understand its learning behavior. Our implementation results demonstrate that the developed algorithm possesses the capability to learn user preferences while successfully adapting to a wide range of environmental conditions and user characteristics. and can deal with a diverse spectrum of environmental conditions and user characteristics. This underscores its viability as a potent solution for intelligent light management, featuring advanced learning capabilities.


title: Are Graph Neural Networks Optimal Approximation Algorithms?

abstract: In this work we design graph neural network architectures that capture optimal approximation algorithms for a large class of combinatorial optimization problems, using powerful algorithmic tools from semidefinite programming (SDP). Concretely, we prove that polynomial-sized message-passing algorithms can represent the most powerful polynomial time algorithms for Max Constraint Satisfaction Problems assuming the Unique Games Conjecture. We leverage this result to construct efficient graph neural network architectures, OptGNN, that obtain high-quality approximate solutions on landmark combinatorial optimization problems such as Max-Cut, Min-Vertex-Cover, and Max-3-SAT. Our approach achieves strong empirical results across a wide range of real-world and synthetic datasets against solvers and neural baselines. Finally, we take advantage of OptGNN's ability to capture convex relaxations to design an algorithm for producing bounds on the optimal solution from the learned embeddings of OptGNN.


title: Self-supervised Learning of Contextualized Local Visual Embeddings

abstract: We present Contextualized Local Visual Embeddings (CLoVE), a self-supervised convolutional-based method that learns representations suited for dense prediction tasks. CLoVE deviates from current methods and optimizes a single loss function that operates at the level of contextualized local embeddings learned from output feature maps of convolution neural network (CNN) encoders. To learn contextualized embeddings, CLoVE proposes a normalized mult-head self-attention layer that combines local features from different parts of an image based on similarity. We extensively benchmark CLoVE's pre-trained representations on multiple datasets. CLoVE reaches state-of-the-art performance for CNN-based architectures in 4 dense prediction downstream tasks, including object detection, instance segmentation, keypoint detection, and dense pose estimation.


title: Turing patterns on a two-component isotropic growing system. Part 3: Time dependent conditions and linear growth

abstract: We propose general conditions for the emergence of Turing patterns in a domain that changes size through homogeneous growth/shrinkage based on the qualitative changes of a potential function. For this part of the work, we consider the most general case where the homogeneous state of the system depends on time. Our hypotheses for the Turing conditions are corroborated with numerical simulations of increasing/decreasing domains of the Brusselator system for the linear growth/shrinking case. The simulations allow us to understand the characteristics of the pattern, its amplitude, and wave number, in addition to allowing us to glimpse the role of time as a bifurcation parameter.


title: Spatiotemporal Image Reconstruction to Enable High-Frame Rate Dynamic Photoacoustic Tomography with Rotating-Gantry Volumetric Imagers

abstract: Significance: Dynamic photoacoustic computed tomography (PACT) is a valuable technique for monitoring physiological processes. However, current dynamic PACT techniques are often limited to 2D spatial imaging. While volumetric PACT imagers are commercially available, these systems typically employ a rotating gantry in which the tomographic data are sequentially acquired. Because the object varies during the data-acquisition process, the sequential data-acquisition poses challenges to image reconstruction associated with data incompleteness. The proposed method is highly significant in that it will address these challenges and enable volumetric dynamic PACT imaging with existing imagers. Aim: The aim of this study is to develop a spatiotemporal image reconstruction (STIR) method for dynamic PACT that can be applied to commercially available volumetric PACT imagers that employ a sequential scanning strategy. The proposed method aims to overcome the challenges caused by the limited number of tomographic measurements acquired per frame. Approach: A low-rank matrix estimation-based STIR method (LRME-STIR) is proposed to enable dynamic volumetric PACT. The LRME-STIR method leverages the spatiotemporal redundancies to accurately reconstruct a 4D spatiotemporal image. Results: The numerical studies substantiate the LRME-STIR method's efficacy in reconstructing 4D dynamic images from measurements acquired with a rotating gantry. The experimental study demonstrates the method's ability to faithfully recover the flow of a contrast agent at a frame rate of 0.1 s even when only a single tomographic measurement per frame is available. Conclusions: The LRME-STIR method offers a promising solution to the challenges faced by enabling 4D dynamic imaging using commercially available volumetric imagers. By enabling accurate 4D reconstruction, this method has the potential to advance preclinical research.


title: Multi-tiling Neural Radiance Field (NeRF) -- Geometric Assessment on Large-scale Aerial Datasets

abstract: Neural Radiance Fields (NeRF) offer the potential to benefit 3D reconstruction tasks, including aerial photogrammetry. However, the scalability and accuracy of the inferred geometry are not well-documented for large-scale aerial assets,since such datasets usually result in very high memory consumption and slow convergence.. In this paper, we aim to scale the NeRF on large-scael aerial datasets and provide a thorough geometry assessment of NeRF. Specifically, we introduce a location-specific sampling technique as well as a multi-camera tiling (MCT) strategy to reduce memory consumption during image loading for RAM, representation training for GPU memory, and increase the convergence rate within tiles. MCT decomposes a large-frame image into multiple tiled images with different camera models, allowing these small-frame images to be fed into the training process as needed for specific locations without a loss of accuracy. We implement our method on a representative approach, Mip-NeRF, and compare its geometry performance with threephotgrammetric MVS pipelines on two typical aerial datasets against LiDAR reference data. Both qualitative and quantitative results suggest that the proposed NeRF approach produces better completeness and object details than traditional approaches, although as of now, it still falls short in terms of accuracy.


title: Separately Convex and Separately Continuous Preferences: On Results of Schmeidler, Shafer, and Bergstrom-Parks-Rader

abstract: We provide necessary and sufficient conditions for a correspondence taking values in a finite-dimensional Euclidean space to be open so as to revisit the pioneering work of Schmeidler (1969), Shafer (1974), Shafer-Sonnenschein (1975) and Bergstrom-Rader-Parks (1976) to answer several questions they and their followers left open. We introduce the notion of separate convexity for a correspondence and use it to relate to classical notions of continuity while giving salience to the notion of separateness as in the interplay of separate continuity and separate convexity of binary relations. As such, we provide a consolidation of the convexity-continuity postulates from a broad inter-disciplinary perspective and comment on how the qualified notions proposed here have implications of substantive interest for choice theory.


title: Statistical Limits of Adaptive Linear Models: Low-Dimensional Estimation and Inference

abstract: Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate estimation and have inflated error. This issue is highlighted by a recent minimax lower bound, which shows that the error of estimating a single coordinate can be enlarged by a multiple of $\sqrt{d}$ when data are allowed to be arbitrarily adaptive, compared with the case when they are i.i.d. Our work explores this striking difference in estimation performance between utilizing i.i.d. and adaptive data. We investigate how the degree of adaptivity in data collection impacts the performance of estimating a low-dimensional parameter component in high-dimensional linear models. We identify conditions on the data collection mechanism under which the estimation error for a low-dimensional parameter component matches its counterpart in the i.i.d. setting, up to a factor that depends on the degree of adaptivity. We show that OLS or OLS on centered data can achieve this matching error. In addition, we propose a novel estimator for single coordinate inference via solving a Two-stage Adaptive Linear Estimating equation (TALE). Under a weaker form of adaptivity in data collection, we establish an asymptotic normality property of the proposed estimator.


title: SELF: Self-Evolution with Language Feedback

abstract: Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a novel approach that enables LLMs to self-improve through self-reflection, akin to human learning processes. SELF initiates with a meta-skill learning process that equips the LLMs with capabilities for self-feedback and self-refinement. Subsequently, the model undergoes an iterative process of self-evolution. In each iteration, it utilizes an unlabeled dataset of instructions to generate initial responses. These responses are enhanced through self-feedback and self-refinement. The model is then fine-tuned using this enhanced data. The model undergoes progressive improvement through this iterative self-evolution process. Moreover, the SELF framework enables the model to apply self-refinement during inference, which further improves response quality. Our experiments in mathematics and general tasks demonstrate that SELF can enhance the capabilities of LLMs without human intervention. The SELF framework indicates a promising direction for the autonomous evolution of LLMs, transitioning them from passive information receivers to active participants in their development.


title: Safe Optimal Interactions Between Automated and Human-Driven Vehicles in Mixed Traffic with Event-triggered Control Barrier Functions

abstract: This paper studies safe driving interactions between Human-Driven Vehicles (HDVs) and Connected and Automated Vehicles (CAVs) in mixed traffic where the dynamics and control policies of HDVs are unknown and hard to predict. In order to address this challenge, we employ event-triggered Control Barrier Functions (CBFs) to estimate the HDV model online, construct data-driven and state-feedback safety controllers, and transform constrained optimal control problems for CAVs into a sequence of event-triggered quadratic programs. We show that we can ensure collision-free between HDVs and CAVs and demonstrate the robustness and flexibility of our framework on different types of human drivers in lane-changing scenarios while guaranteeing safety with human-in-the-loop interactions.


title: JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention

abstract: We propose Joint MLP/Attention (JoMA) dynamics, a novel mathematical framework to understand the training procedure of multilayer Transformer architectures. This is achieved by integrating out the self-attention layer in Transformers, producing a modified dynamics of MLP layers only. JoMA removes unrealistic assumptions in previous analysis (e.g., lack of residual connection) and predicts that the attention first becomes sparse (to learn salient tokens), then dense (to learn less salient tokens) in the presence of nonlinear activations, while in the linear case, it is consistent with existing works that show attention becomes sparse over time. We leverage JoMA to qualitatively explains how tokens are combined to form hierarchies in multilayer Transformers, when the input tokens are generated by a latent hierarchical generative model. Experiments on models trained from real-world dataset (Wikitext2/Wikitext103) and various pre-trained models (OPT, Pythia) verify our theoretical findings. Code can be found in https://github.com/facebookresearch/luckmatters/tree/yuandong3.


title: Computing the alpha complex using dual active set methods

abstract: The alpha complex is a fundamental data structure from computational geometry, which encodes the topological type of a union of balls $B(x; r) \subset \mathbb{R}^m$ for $x\in S$, including a weighted version that allows for varying radii. It consists of the collection of "simplices" $\sigma = \{x_0, ..., x_k \} \subset S$, which correspond to nomempty $(k + 1)$-fold intersections of cells in a radius-restricted version of the Voronoi diagram. Existing algorithms for computing the alpha complex require that the points reside in low dimension because they begin by computing the entire Delaunay complex, which rapidly becomes intractable, even when the alpha complex is of a reasonable size. This paper presents a method for computing the alpha complex without computing the full Delaunay triangulation by applying Lagrangian duality, specifically an algorithm based on dual quadratic programming that seeks to rule simplices out rather than ruling them in.


title: On the Existence of Solution of Conservation Law with Moving Bottleneck and Discontinuity in FLux

abstract: In this paper, a PDE-ODE model with discontinuity in the flux as well as a flux constraint is analyzed. A modified Riemann solution is proposed and the existence of a weak solution to the Cauchy problem is rigorously investigated using the wavefront tracking scheme.


title: On Cayley algorithm for double partition

abstract: A double partition problem asks for a number of nonnegative integer solutions to a system of two linear Diophantine equations with integer coefficients. Artur Cayley suggested a reduction of a double partition to a sum of scalar partitions with an algorithm subject to a set of conditions. We show that when these conditions are not satisfied and the original algorithm fails its modification solves the reduction problem.


title: Thompson Exploration with Best Challenger Rule in Best Arm Identification

abstract: This paper studies the fixed-confidence best arm identification (BAI) problem in the bandit framework in the canonical single-parameter exponential models. For this problem, many policies have been proposed, but most of them require solving an optimization problem at every round and/or are forced to explore an arm at least a certain number of times except those restricted to the Gaussian model. To address these limitations, we propose a novel policy that combines Thompson sampling with a computationally efficient approach known as the best challenger rule. While Thompson sampling was originally considered for maximizing the cumulative reward, we demonstrate that it can be used to naturally explore arms in BAI without forcing it. We show that our policy is asymptotically optimal for any two-armed bandit problems and achieves near optimality for general $K$-armed bandit problems for $K\geq 3$. Nevertheless, in numerical experiments, our policy shows competitive performance compared to asymptotically optimal policies in terms of sample complexity while requiring less computation cost. In addition, we highlight the advantages of our policy by comparing it to the concept of $\beta$-optimality, a relaxed notion of asymptotic optimality commonly considered in the analysis of a class of policies including the proposed one.


title: Machine Learning-driven Analysis of Gastrointestinal Symptoms in Post-COVID-19 Patients

abstract: The COVID-19 pandemic, caused by the novel coronavirus SARS-CoV-2, has posed significant health challenges worldwide. While respiratory symptoms have been the primary focus, emerging evidence has highlighted the impact of COVID-19 on various organ systems, including the gastrointestinal (GI) tract. This study, based on data from 913 post-COVID-19 patients in Iraq collected during 2022 and 2023, investigates the prevalence and patterns of GI symptoms in individuals recovering from COVID-19 and leverages machine learning algorithms to identify predictive factors for these symptoms. The research findings reveal that a notable percentage of post-COVID-19 patients experience GI symptoms during their recovery phase. Diarrhea emerged as the most frequently reported symptom, followed by abdominal pain and nausea. Machine learning analysis uncovered significant predictive factors for GI symptoms, including age, gender, disease severity, comorbidities, and the duration of COVID-19 illness. These findings underscore the importance of monitoring and addressing GI symptoms in post-COVID-19 care, with machine learning offering valuable tools for early identification and personalized intervention. This study contributes to the understanding of the long-term consequences of COVID-19 on GI health and emphasizes the potential benefits of utilizing machine learning-driven analysis in predicting and managing these symptoms. Further research is warranted to delve into the mechanisms underlying GI symptoms in COVID-19 survivors and to develop targeted interventions for symptom management. Keywords: COVID-19, gastrointestinal symptoms, machine learning, predictive factors, post-COVID-19 care, long COVID.


title: Robust Nonparametric Hypothesis Testing to Understand Variability in Training Neural Networks

abstract: Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model. Several works suggest this variability is negligible when models have the same performance, which in the case of classification is test accuracy. However, models with similar test accuracy may not be computing the same function. We propose a new measure of closeness between classification models based on the output of the network before thresholding. Our measure is based on a robust hypothesis-testing framework and can be adapted to other quantities derived from trained models.


title: Watch Out! Simple Horizontal Class Backdoor Can Trivially Evade Defense

abstract: All current backdoor attacks on deep learning (DL) models fall under the category of a vertical class backdoor (VCB) -- class-dependent. In VCB attacks, any sample from a class activates the implanted backdoor when the secret trigger is present. Existing defense strategies overwhelmingly focus on countering VCB attacks, especially those that are source-class-agnostic. This narrow focus neglects the potential threat of other simpler yet general backdoor types, leading to false security implications. This study introduces a new, simple, and general type of backdoor attack coined as the horizontal class backdoor (HCB) that trivially breaches the class dependence characteristic of the VCB, bringing a fresh perspective to the community. HCB is now activated when the trigger is presented together with an innocuous feature, regardless of class. For example, the facial recognition model misclassifies a person who wears sunglasses with a smiling innocuous feature into the targeted person, such as an administrator, regardless of which person. The key is that these innocuous features are horizontally shared among classes but are only exhibited by partial samples per class. Extensive experiments on attacking performance across various tasks, including MNIST, facial recognition, traffic sign recognition, object detection, and medical diagnosis, confirm the high efficiency and effectiveness of the HCB. We rigorously evaluated the evasiveness of the HCB against a series of eleven representative countermeasures, including Fine-Pruning (RAID 18'), STRIP (ACSAC 19'), Neural Cleanse (Oakland 19'), ABS (CCS 19'), Februus (ACSAC 20'), NAD (ICLR 21'), MNTD (Oakland 21'), SCAn (USENIX SEC 21'), MOTH (Oakland 22'), Beatrix (NDSS 23'), and MM-BD (Oakland 24'). None of these countermeasures prove robustness, even when employing a simplistic trigger, such as a small and static white-square patch.


title: Elucidating Dynamic Conductive State Changes in Amorphous Lithium Lanthanum Titanate for Resistive Switching Devices

abstract: Exploration of novel resistive switching materials attracts attention to replace conventional Si-based transistors and to achieve neuromorphic computing that can surpass the limit of the current Von-Neumann computing for the time of Internet of Things (IoT). Materials priorly used to serve in batteries have demonstrated metal-insulator transitions upon an electrical biasing due to resulting compositional change. This property is desirable for future resistive switching devices. Amorphous lithium lanthanum titanate (a-LLTO) was originally developed as a solid-state electrolyte with relatively high lithium ionic conductivity and low electronic conductivity among oxide-type solid electrolytes. However, it has been suggested that electric conductivity of a-LLTO changes depending on oxygen content. In this work, the investigation of switching behavior of a-LLTO was conducted by employing a range of voltage sweep techniques, ultimately establishing a stable and optimal operating condition within the voltage window of -3.5 V to 3.5 V. This voltage range effectively balances the desirable trait of a substantial resistance change by three orders of magnitude with the imperative avoidance of LLTO decomposition. This switching behavior is also confirmed at nanodevice of Ni/LLTO/Ni through in-situ biasing inside focused-ion beam/scanning electron microscope (FIB-SEM). Experiment and computation with different LLTO composition shows that LLTO has two distinct conductivity states due to Ti reduction. The distribution of these two states is discussed using simplified binary model, implying the conductive filament growth during low resistance state. Consequently, our study deepens understanding of LLTO electronic properties and encourages the interdisciplinary application of battery materials for resistive switching devices.


title: Solving stationary nonlinear Fokker-Planck equations via sampling

abstract: Solving the stationary nonlinear Fokker-Planck equations is important in applications and examples include the Poisson-Boltzmann equation and the two layer neural networks. Making use of the connection between the interacting particle systems and the nonlinear Fokker-Planck equations, we propose to solve the stationary solution by sampling from the $N$-body Gibbs distribution. This avoids simulation of the $N$-body system for long time and more importantly such a method can avoid the requirement of uniform propagation of chaos from direct simulation of the particle systems. We establish the convergence of the Gibbs measure to the stationary solution when the interaction kernel is bounded (not necessarily continuous) and the temperature is not very small. Numerical experiments are performed for the Poisson-Boltzmann equations and the two-layer neural networks to validate the method and the theory.


title: Implicit Neural Representations and the Algebra of Complex Wavelets

abstract: Implicit neural representations (INRs) have arisen as useful methods for representing signals on Euclidean domains. By parameterizing an image as a multilayer perceptron (MLP) on Euclidean space, INRs effectively represent signals in a way that couples spatial and spectral features of the signal that is not obvious in the usual discrete representation, paving the way for continuous signal processing and machine learning approaches that were not previously possible. Although INRs using sinusoidal activation functions have been studied in terms of Fourier theory, recent works have shown the advantage of using wavelets instead of sinusoids as activation functions, due to their ability to simultaneously localize in both frequency and space. In this work, we approach such INRs and demonstrate how they resolve high-frequency features of signals from coarse approximations done in the first layer of the MLP. This leads to multiple prescriptions for the design of INR architectures, including the use of complex wavelets, decoupling of low and band-pass approximations, and initialization schemes based on the singularities of the desired signal.


title: Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realisation

abstract: In document processing, seal-related tasks have very large commercial applications, such as seal segmentation, seal authenticity discrimination, seal removal, and text recognition under seals. However, these seal-related tasks are highly dependent on labelled document seal datasets, resulting in very little work on these tasks. To address the lack of labelled datasets for these seal-related tasks, we propose Seal2Real, a generative method that generates a large amount of labelled document seal data, and construct a Seal-DB dataset containing 20K images with labels. In Seal2Real, we propose a prompt prior learning architecture based on a pre-trained Stable Diffusion Model that migrates the prior generative power of to our seal generation task with unsupervised training. The realistic seal generation capability greatly facilitates the performance of downstream seal-related tasks on real data. Experimental results on the Seal-DB dataset demonstrate the effectiveness of Seal2Real.


title: {SSH coupled-spring systems

abstract: It is known that there is also a topological phase in the SSH coupled-spring system with the fixed-end boundary conditions. When this is the case, there would exist edge modes on its boundaries. In contrast, if the system satisfies the free-end boundary conditions, there is no edge mode, even if it is the topological phase. We show that by varying the force constant of the spring by the boundary in such a system, edge modes would generally appear independent of whether the bulk of the system is in the topological or trivial phases. Moreover, edge modes could exist even if the system satisfies the free-end boundary conditions.


title: An Experimental Prototype for Multistatic Asynchronous ISAC

abstract: We prototype and validate a multistatic mmWave ISAC system based on IEEE802.11ay. Compensation of the clock asynchrony between each TX and RX pair is performed using the sole LoS wireless signal propagation. As a result, our system provides concurrent target tracking and micro-Doppler estimation from multiple points of view, paving the way for practical multistatic data fusion. Our results on human movement sensing, complemented with precise, quantitative GT data, demonstrate the enhanced sensing capabilities of multistatic ISAC, due to the spatial diversity of the receiver nodes.


title: Convex Restriction of Feasible Sets for AC Radial Networks

abstract: Many problems in power systems involve optimizing a certain objective function subject to power flow equations and engineering constraints. A long-standing challenge in solving them is the nonconvexity of their feasible sets. In this paper, we propose an analytical method to construct the convex restriction of the feasible set for AC power flows in radial networks. The construction relies on simple geometrical ideas and is explicit, in the sense that it does not involve solving other complicated optimization problems. We also show that the construct restrictions are in some sense maximal, that is, the best possible ones. Optimization problems constrained to these sets are not only simpler to solve but also offer feasibility guarantee for the solutions to the original OPF problem. Furthermore, we present an iterative algorithm to improve on the solution quality by successively constructing a sequence of convex restricted sets and solving the optimization on them. The numerical experiments on the IEEE 123-bus distribution network show that our method finds good feasible solutions within just a few iterations and works well with various objective functions, even in situations where traditional methods fail to return a solution.


title: Ultralight Dirac neutrinos from nearly degenerate Higgs doublets

abstract: Two Higgs doublets respect a mirror symmetry with spontaneous violation so that their vacuum expectation values can realize a small difference. Under this symmetry, three newly introduced right-handed neutrinos rather than the standard model fermions perform an odd transformation. Accordingly the neutrino masses and the charged fermion masses respectively are proportional to the difference and sum of the vacuum expectation values of two Higgs doublets. From a phenomenological perspective, such nearly degenerate Higgs doublets with large cancellation are equivalent to a Dirac seesaw mechanism with high suppression.


title: Derivative based global sensitivity analysis and its entropic link

abstract: Variance-based Sobol' sensitivity is one of the most well known measures in global sensitivity analysis (GSA). However, uncertainties with certain distributions, such as highly skewed distributions or those with a heavy tail, cannot be adequately characterised using the second central moment only. Entropy-based GSA can consider the entire probability density function, but its application has been limited because it is difficult to estimate. Here we present a novel derivative-based upper bound for conditional entropies, to efficiently rank uncertain variables and to work as a proxy for entropy-based total effect indices. To overcome the non-desirable issue of negativity for differential entropies as sensitivity indices, we discuss an exponentiation of the total effect entropy and its proxy. We found that the proposed new entropy proxy is equivalent to the proxy for variance-based GSA for linear functions with Gaussian inputs, but outperforms the latter for a river flood physics model with 8 inputs of different distributions. We expect the new entropy proxy to increase the variable screening power of derivative-based GSA and to complement Sobol'-index proxy for a more diverse type of distributions.


abstract: Unsupervised relation extraction (URE) aims at discovering underlying relations between named entity pairs from open-domain plain text without prior information on relational distribution. Existing URE models utilizing contrastive learning, which attract positive samples and repulse negative samples to promote better separation, have got decent effect. However, fine-grained relational semantic in relationship makes spurious negative samples, damaging the inherent hierarchical structure and hindering performances. To tackle this problem, we propose Siamese Representation Learning for Unsupervised Relation Extraction -- a novel framework to simply leverage positive pairs to representation learning, possessing the capability to effectively optimize relation representation of instances and retain hierarchical information in relational feature space. Experimental results show that our model significantly advances the state-of-the-art results on two benchmark datasets and detailed analyses demonstrate the effectiveness and robustness of our proposed model on unsupervised relation extraction.


title: Robust Asset-Liability Management

abstract: How should financial institutions hedge their balance sheets against interest rate risk when they have long-term assets and liabilities? Using the perspective of functional and numerical analysis, we propose a model-free bond portfolio selection method that generalizes classical immunization and accommodates arbitrary liability structure, portfolio constraints, and perturbations in interest rates. We prove the generic existence of an immunizing portfolio that maximizes the worst-case equity with a tight error estimate and provide a solution algorithm. Numerical evaluations using empirical and simulated yield curves from a no-arbitrage term structure model support the feasibility and accuracy of our approach relative to existing methods.


title: Detecting rare and weak deviations of non-proportional hazard in survival analysis

abstract: We propose a new method to compare survival data based on Higher Criticism (HC) of P-values obtained from many exact hypergeometric tests. The method can accommodate censorship and is sensitive to moderate differences in some unknown and relatively few time intervals, attaining much better power against such differences than the log-rank test and other tests that are popular under non-proportional hazard alternatives. We demonstrate the usefulness of the HC-based test in detecting rare differences compared to existing tests using simulated data and using actual gene expression data. Additionally, we analyze the asymptotic power of our method under a piece-wise homogeneous exponential decay model with rare and weak departures, describing two groups experiencing failure rates that are usually identical over time except in a few unknown instances in which the second group's failure rate is higher. Under an asymptotic calibration of the model's parameters, the HC-based test's power experiences a phase transition across the plane involving the rarity and intensity parameters that mirrors the phase transition in a two-sample rare and weak normal means setting. In particular, the phase transition curve of our test indicates a larger region in which it is fully powered than the corresponding region of the log-rank test. %The latter attains a phase transition curve that is analogous to a test based on Fisher's combination statistic of the hypergeometric P-values. %To our knowledge, this is the first analysis of a rare and weak signal detection model that involves individually dependent effects in a non-Gaussian setting.


title: An IRS-Assisted Secure Dual-Function Radar-Communication System

abstract: In dual-function radar-communication (DFRC) systems the probing signal contains information intended for the communication users, which makes that information vulnerable to eavesdropping by the targets. We propose a novel design for enhancing the physical layer security (PLS) of DFRC systems, via the help of intelligent reflecting surface (IRS) and artificial noise (AN), transmitted along with the probing waveform. The radar waveform, the AN jamming noise and the IRS parameters are designed to optimize the communication secrecy rate while meeting radar signal-to-noise ratio (SNR) constrains. Key challenges in the resulting optimization problem include the fractional form objective, the SNR being a quartic function of the IRS parameters, and the unit-modulus constraint of the IRS parameters. A fractional programming technique is used to transform the fractional form objective of the optimization problem into more tractable non-fractional polynomials. Numerical results are provided to demonstrate the convergence of the proposed system design algorithm, and also show the impact of the power assigned to the AN on the secrecy performance of the designed system.


title: Axial Symmetry of Normalized Solutions for Magnetic Gross-Pitaevskii Equations with Anharmonic Potentials

abstract: This paper is concerned with normalized solutions of the magnetic focusing Gross-Pitaevskii equations with anharmonic potentials in $\R^N$, where $N=2,3$. The existence of axially symmetric solutions is constructed as the parameter $a>0$ satisfies $a \to a_*(N)$, where $a_*(N)\geq0$ is a critical constant depending only on $N$. We further prove that up to the constant phase and rotational transformation, normalized concentrating solutions as $a\to a_*(N)$ must be unique and axially symmetric. As a byproduct, we also obtain that for the case $N=3$, the normalized concentrating solution as $a\to a_*(3)$ is free of vortices, where the anharmonic potential is non-radially symmetric.


title: Outerplanar Tur\'an number of a cycle

abstract: A graph is outerplanar if it has a planar drawing for which all vertices belong to the outer face of the drawing. Let $H$ be a graph. The outerplanar Tur\'an number of $H$, denoted by $ex_\mathcal{OP}(n,H)$, is the maximum number of edges in an $n$-vertex outerplanar graph which does not contain $H$ as a subgraph. In 2021, L. Fang et al. determined the outerplanar Tur\'an number of cycles and paths. In this paper, we use techniques of dual graph to give a shorter proof for the sharp upperbound of $ex_\mathcal{OP}(n,C_k)\leq \frac{(2k - 5)(kn - k - 1)}{k^2 - 2k - 1}$.


title: Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes

abstract: When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.


title: CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression

abstract: Lossy image coding standards such as JPEG and MPEG have successfully achieved high compression rates for human consumption of multimedia data. However, with the increasing prevalence of IoT devices, drones, and self-driving cars, machines rather than humans are processing a greater portion of captured visual content. Consequently, it is crucial to pursue an efficient compressed representation that caters not only to human vision but also to image processing and machine vision tasks. Drawing inspiration from the efficient coding hypothesis in biological systems and the modeling of the sensory cortex in neural science, we repurpose the compressed latent representation to prioritize semantic relevance while preserving perceptual distance. Our proposed method, Compressed Perceptual Image Patch Similarity (CPIPS), can be derived at a minimal cost from a learned neural codec and computed significantly faster than DNN-based perceptual metrics such as LPIPS and DISTS.


title: Joint Task Scheduling and Container Image Caching in Edge Computing

abstract: In Edge Computing (EC), containers have been increasingly used to deploy applications to provide mobile users services. Each container must run based on a container image file that exists locally. However, it has been conspicuously neglected by existing work that effective task scheduling combined with dynamic container image caching is a promising way to reduce the container image download time with the limited bandwidth resource of edge nodes. To fill in such gaps, in this paper, we propose novel joint Task Scheduling and Image Caching (TSIC) algorithms, specifically: 1) We consider the joint task scheduling and image caching problem and formulate it as a Markov Decision Process (MDP), taking the communication delay, waiting delay, and computation delay into consideration; 2) To solve the MDP problem, a TSIC algorithm based on deep reinforcement learning is proposed with the customized state and action spaces and combined with an adaptive caching update algorithm. 3) A real container system is implemented to validate our algorithms. The experiments show that our strategy outperforms the existing baseline approaches by 23\% and 35\% on average in terms of total delay and waiting delay, respectively.


title: CausalGPS: An R Package for Causal Inference With Continuous Exposures

abstract: Quantifying the causal effects of continuous exposures on outcomes of interest is critical for social, economic, health, and medical research. However, most existing software packages focus on binary exposures. We develop the CausalGPS R package that implements a collection of algorithms to provide algorithmic solutions for causal inference with continuous exposures. CausalGPS implements a causal inference workflow, with algorithms based on generalized propensity scores (GPS) as the core, extending propensity scores (the probability of a unit being exposed given pre-exposure covariates) from binary to continuous exposures. As the first step, the package implements efficient and flexible estimations of the GPS, allowing multiple user-specified modeling options. As the second step, the package provides two ways to adjust for confounding: weighting and matching, generating weighted and matched data sets, respectively. Lastly, the package provides built-in functions to fit flexible parametric, semi-parametric, or non-parametric regression models on the weighted or matched data to estimate the exposure-response function relating the outcome with the exposures. The computationally intensive tasks are implemented in C++, and efficient shared-memory parallelization is achieved by OpenMP API. This paper outlines the main components of the CausalGPS R package and demonstrates its application to assess the effect of long-term exposure to PM2.5 on educational attainment using zip code-level data from the contiguous United States from 2000-2016.


title: Discrete Choice Multi-Armed Bandits

abstract: This paper establishes a connection between a category of discrete choice models and the realms of online learning and multiarmed bandit algorithms. Our contributions can be summarized in two key aspects. Firstly, we furnish sublinear regret bounds for a comprehensive family of algorithms, encompassing the Exp3 algorithm as a particular case. Secondly, we introduce a novel family of adversarial multiarmed bandit algorithms, drawing inspiration from the generalized nested logit models initially introduced by \citet{wen:2001}. These algorithms offer users the flexibility to fine-tune the model extensively, as they can be implemented efficiently due to their closed-form sampling distribution probabilities. To demonstrate the practical implementation of our algorithms, we present numerical experiments, focusing on the stochastic bandit case.


title: Ground States of Fermionic Nonlinear Schr\"{o}dinger Systems with Coulomb Potential I: The $L^2$-Subcritical Case

abstract: We consider ground states of the $N$ coupled fermionic nonlinear Schr\"{o}dinger systems with the Coulomb potential $V(x)$ in the $L^2$-subcritical case. By studying the associated constraint variational problem, we prove the existence of ground states for the system with any parameter $\alpha>0$, which represents the attractive strength of the non-relativistic quantum particles. The limiting behavior of ground states for the system is also analyzed as $\alpha\to\infty$, where the mass concentrates at one of the singular points for the Coulomb potential $V(x)$.


title: DYNAP-SE2: a scalable multi-core dynamic neuromorphic asynchronous spiking neural network processor

abstract: With the remarkable progress that technology has made, the need for processing data near the sensors at the edge has increased dramatically. The electronic systems used in these applications must process data continuously, in real-time, and extract relevant information using the smallest possible energy budgets. A promising approach for implementing always-on processing of sensory signals that supports on-demand, sparse, and edge-computing is to take inspiration from biological nervous system. Following this approach, we present a brain-inspired platform for prototyping real-time event-based Spiking Neural Networks (SNNs). The system proposed supports the direct emulation of dynamic and realistic neural processing phenomena such as short-term plasticity, NMDA gating, AMPA diffusion, homeostasis, spike frequency adaptation, conductance-based dendritic compartments and spike transmission delays. The analog circuits that implement such primitives are paired with a low latency asynchronous digital circuits for routing and mapping events. This asynchronous infrastructure enables the definition of different network architectures, and provides direct event-based interfaces to convert and encode data from event-based and continuous-signal sensors. Here we describe the overall system architecture, we characterize the mixed signal analog-digital circuits that emulate neural dynamics, demonstrate their features with experimental measurements, and present a low- and high-level software ecosystem that can be used for configuring the system. The flexibility to emulate different biologically plausible neural networks, and the chip's ability to monitor both population and single neuron signals in real-time, allow to develop and validate complex models of neural processing for both basic research and edge-computing applications.


title: Extensions of Multilinear Module Expansions

abstract: We consider the deconstruction/reconstruction of extensions in varieties of algebras which are modules expanded by multilinear operators. The parametrization of extensions determined by abelian ideals with unary actions agrees with the previous development of extensions realizing affine datum in arbitrary varieties of universal algebras. We establish a Well's type theorem which, for a fixed affine ideal, characterizes those ideal-preserving derivations of a group-trivial extension as a Lie algebra extension of the compatible pairs of derivations of the datum algebras associated to the ideal by the cohomological derivations of the datum. For these varieties, we establish a low-dimensional Hochschild-Serre exact sequence associated to an arbitrary extension equipped with an additional affine action.


title: Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models

abstract: In the financial industry, credit scoring is a fundamental element, shaping access to credit and determining the terms of loans for individuals and businesses alike. Traditional credit scoring methods, however, often grapple with challenges such as narrow knowledge scope and isolated evaluation of credit tasks. Our work posits that Large Language Models (LLMs) have great potential for credit scoring tasks, with strong generalization ability across multiple tasks. To systematically explore LLMs for credit scoring, we propose the first open-source comprehensive framework. We curate a novel benchmark covering 9 datasets with 14K samples, tailored for credit assessment and a critical examination of potential biases within LLMs, and the novel instruction tuning data with over 45k samples. We then propose the first Credit and Risk Assessment Large Language Model (CALM) by instruction tuning, tailored to the nuanced demands of various financial risk assessment tasks. We evaluate CALM, existing state-of-art (SOTA) methods, open source and closed source LLMs on the build benchmark. Our empirical results illuminate the capability of LLMs to not only match but surpass conventional models, pointing towards a future where credit scoring can be more inclusive, comprehensive, and unbiased. We contribute to the industry's transformation by sharing our pioneering instruction-tuning datasets, credit and risk assessment LLM, and benchmarks with the research community and the financial industry.


title: Understanding the Robustness of Randomized Feature Defense Against Query-Based Adversarial Attacks

abstract: Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ black-box attacks to generate such adversarial examples. In this work, we propose a simple and lightweight defense against black-box attacks by adding random noise to hidden features at intermediate layers of the model at inference time. Our theoretical analysis confirms that this method effectively enhances the model's resilience against both score-based and decision-based black-box attacks. Importantly, our defense does not necessitate adversarial training and has minimal impact on accuracy, rendering it applicable to any pre-trained model. Our analysis also reveals the significance of selectively adding noise to different parts of the model based on the gradient of the adversarial objective function, which can be varied during the attack. We demonstrate the robustness of our defense against multiple black-box attacks through extensive empirical experiments involving diverse models with various architectures.


title: Image Data Hiding in Neural Compressed Latent Representations

abstract: We propose an end-to-end learned image data hiding framework that embeds and extracts secrets in the latent representations of a generic neural compressor. By leveraging a perceptual loss function in conjunction with our proposed message encoder and decoder, our approach simultaneously achieves high image quality and high bit accuracy. Compared to existing techniques, our framework offers superior image secrecy and competitive watermarking robustness in the compressed domain while accelerating the embedding speed by over 50 times. These results demonstrate the potential of combining data hiding techniques and neural compression and offer new insights into developing neural compression techniques and their applications.


title: TDCGL: Two-Level Debiased Contrastive Graph Learning for Recommendation

abstract: knowledge graph-based recommendation methods have achieved great success in the field of recommender systems. However, over-reliance on high-quality knowledge graphs is a bottleneck for such methods. Specifically, the long-tailed distribution of entities of KG and noise issues in the real world will make item-entity dependent relations deviate from reflecting true characteristics and significantly harm the performance of modeling user preference. Contrastive learning, as a novel method that is employed for data augmentation and denoising, provides inspiration to fill this research gap. However, the mainstream work only focuses on the long-tail properties of the number of items clicked, while ignoring that the long-tail properties of total number of clicks per user may also affect the performance of the recommendation model. Therefore, to tackle these problems, motivated by the Debiased Contrastive Learning of Unsupervised Sentence Representations (DCLR), we propose Two-Level Debiased Contrastive Graph Learning (TDCGL) model. Specifically, we design the Two-Level Debiased Contrastive Learning (TDCL) and deploy it in the KG, which is conducted not only on User-Item pairs but also on User-User pairs for modeling higher-order relations. Also, to reduce the bias caused by random sampling in contrastive learning, with the exception of the negative samples obtained by random sampling, we add a noise-based generation of negation to ensure spatial uniformity. Considerable experiments on open-source datasets demonstrate that our method has excellent anti-noise capability and significantly outperforms state-of-the-art baselines. In addition, ablation studies about the necessity for each level of TDCL are conducted.


title: LaPLACE: Probabilistic Local Model-Agnostic Causal Explanations

abstract: Machine learning models have undeniably achieved impressive performance across a range of applications. However, their often perceived black-box nature, and lack of transparency in decision-making, have raised concerns about understanding their predictions. To tackle this challenge, researchers have developed methods to provide explanations for machine learning models. In this paper, we introduce LaPLACE-explainer, designed to provide probabilistic cause-and-effect explanations for any classifier operating on tabular data, in a human-understandable manner. The LaPLACE-Explainer component leverages the concept of a Markov blanket to establish statistical boundaries between relevant and non-relevant features automatically. This approach results in the automatic generation of optimal feature subsets, serving as explanations for predictions. Importantly, this eliminates the need to predetermine a fixed number N of top features as explanations, enhancing the flexibility and adaptability of our methodology. Through the incorporation of conditional probabilities, our approach offers probabilistic causal explanations and outperforms LIME and SHAP (well-known model-agnostic explainers) in terms of local accuracy and consistency of explained features. LaPLACE's soundness, consistency, local accuracy, and adaptability are rigorously validated across various classification models. Furthermore, we demonstrate the practical utility of these explanations via experiments with both simulated and real-world datasets. This encompasses addressing trust-related issues, such as evaluating prediction reliability, facilitating model selection, enhancing trustworthiness, and identifying fairness-related concerns within classifiers.