title: Is a Recent Surge in Global Warming Detectable?

abstract: The global mean surface temperature is widely studied to monitor climate change. A current debate centers around whether there has been a recent (post-1970s) surge/acceleration in the warming rate. This paper addresses whether an acceleration in the warming rate is detectable from a statistical perspective. We use changepoint models, which are statistical techniques specifically designed for identifying structural changes in time series. Four global mean surface temperature records over 1850-2023 are scrutinized within. Our results show limited evidence for a warming surge; in most surface temperature time series, no change in the warming rate beyond the 1970s is detected. As such, we estimate minimum changes in the warming trend for a surge to be detectable in the near future.


title: Exploring Spatial Generalized Functional Linear Models: A Comparative Simulation Study and Analysis of COVID-19

abstract: Implementation of spatial generalized linear models with a functional covariate can be accomplished through the use of a truncated basis expansion of the covariate process. In practice, one must select a truncation level for use. We compare five criteria for the selection of an appropriate truncation level, including AIC and BIC based on a log composite likelihood, a fraction of variance explained criterion, a fitted mean squared error, and a prediction error with one standard error rule. Based on the use of extensive simulation studies, we propose that BIC constitutes a reasonable default criterion for the selection of the truncation level for use in a spatial functional generalized linear model. In addition, we demonstrate that the spatial model with a functional covariate outperforms other models when the data contain spatial structure and response variables are in fact influenced by a functional covariate process. We apply the spatial functional generalized linear model to a problem in which the objective is to relate COVID-19 vaccination rates in counties of states in the Midwestern United States to the number of new cases from previous weeks in those same geographic regions.


title: Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection

abstract: Effective weed control plays a crucial role in optimizing crop yield and enhancing agricultural product quality. However, the reliance on herbicide application not only poses a critical threat to the environment but also promotes the emergence of resistant weeds. Fortunately, recent advances in precision weed management enabled by ML and DL provide a sustainable alternative. Despite great progress, existing algorithms are mainly developed based on supervised learning approaches, which typically demand large-scale datasets with manual-labeled annotations, which is time-consuming and labor-intensive. As such, label-efficient learning methods, especially semi-supervised learning, have gained increased attention in the broader domain of computer vision and have demonstrated promising performance. These methods aim to utilize a small number of labeled data samples along with a great number of unlabeled samples to develop high-performing models comparable to the supervised learning counterpart trained on a large amount of labeled data samples. In this study, we assess the effectiveness of a semi-supervised learning framework for multi-class weed detection, employing two well-known object detection frameworks, namely FCOS and Faster-RCNN. Specifically, we evaluate a generalized student-teacher framework with an improved pseudo-label generation module to produce reliable pseudo-labels for the unlabeled data. To enhance generalization, an ensemble student network is employed to facilitate the training process. Experimental results show that the proposed approach is able to achieve approximately 76\% and 96\% detection accuracy as the supervised methods with only 10\% of labeled data in CottenWeedDet3 and CottonWeedDet12, respectively. We offer access to the source code, contributing a valuable resource for ongoing semi-supervised learning research in weed detection and beyond.


title: CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solver

abstract: We propose an RNN-based efficient Ising model solver, the Criticality-ordered Recurrent Mean Field (CoRMF), for forward Ising problems. In its core, a criticality-ordered spin sequence of an $N$-spin Ising model is introduced by sorting mission-critical edges with greedy algorithm, such that an autoregressive mean-field factorization can be utilized and optimized with Recurrent Neural Networks (RNNs). Our method has two notable characteristics: (i) by leveraging the approximated tree structure of the underlying Ising graph, the newly-obtained criticality order enables the unification between variational mean-field and RNN, allowing the generally intractable Ising model to be efficiently probed with probabilistic inference; (ii) it is well-modulized, model-independent while at the same time expressive enough, and hence fully applicable to any forward Ising inference problems with minimal effort. Computationally, by using a variance-reduced Monte Carlo gradient estimator, CoRFM solves the Ising problems in a self-train fashion without data/evidence, and the inference tasks can be executed by directly sampling from RNN. Theoretically, we establish a provably tighter error bound than naive mean-field by using the matrix cut decomposition machineries. Numerically, we demonstrate the utility of this framework on a series of Ising datasets.


title: Pulse shape discrimination in an organic scintillation phoswich detector using machine learning techniques

abstract: We developed machine learning algorithms for distinguishing scintillation signals from a plastic-liquid coupled detector known as a phoswich. The challenge lies in discriminating signals from organic scintillators with similar shapes and short decay times. Using a single-readout phoswich detector, we successfully identified $\gamma$ radiation signals from two scintillating components. Our Boosted Decision Tree algorithm demonstrated a maximum discrimination power of 3.02 $\pm$ 0.85 standard deviation in the 950 keV region, providing an efficient solution for self-shielding and enhancing radiation detection capabilities.


title: Microscopic description of hexadecapole collectivity in even-even rare-earth nuclei near $N=90$

abstract: We present an extensive study of hexadecapole correlations in the rare-earth region near $N=90$ and the effects these correlations have on various nuclear properties, such as the low-energy spectra, as well as quadrupole, hexadecapole, and monopole transition strengths. In order to examine hexadecapole correlations, we employ a mapped $sdg$ interacting boson model, with parameters derived from a self-consistent mean-field calculations with a relativistic energy density functional. We apply this model to even-even isotopes of Nd, Sm, Gd, Dy, and Er ($Z=60 - 68$) with neutron numbers $N=84-96$. The obtained results show a good agreement with the experiment. By comparing the results with the ones obtained from a simpler mapped $sd$ interacting boson model, we show that the inclusion of the hexadecapole degree of freedom via $g$ boson is necessary to improve the results of the $J^{\pi} \geq 6^{+}$ yrast energies in the nuclei with $N=84$ and 86, being near the neutron shell closure. The $sdg$ interacting boson model increases the quadrupole transition strengths between yrast states in the $N=90$ and 92 well deformed nuclei, which is in good agreement with the experiment for most of those isotopes. The presence of $g$ bosons does have an important effect on hexadecapole transition strengths, although experimental data for such transitions are limited. The obtained monopole transition strengths do not differ significantly from the ones obtained from the simpler $sd$ model.


title: Multiple Update Particle Filter: Position Estimation by Combining GNSS Pseudorange and Carrier Phase Observations

abstract: This paper presents an efficient method for updating particles in a particle filter (PF) to address the position estimation problem when dealing with sharp-peaked likelihood functions derived from multiple observations. Sharp-peaked likelihood functions commonly arise from millimeter-accurate distance observations of carrier phases in the global navigation satellite system (GNSS). However, when such likelihood functions are used for particle weight updates, the absence of particles within the peaks leads to all particle weights becoming zero. To overcome this problem, in this study, a straightforward and effective approach is introduced for updating particles when dealing with sharp-peaked likelihood functions obtained from multiple observations. The proposed method, termed as the multiple update PF, leverages prior knowledge regarding the spread of distribution for each likelihood function and conducts weight updates and resampling iteratively in the particle update process, prioritizing the likelihood function spreads. Experimental results demonstrate the efficacy of our proposed method, particularly when applied to position estimation utilizing GNSS pseudorange and carrier phase observations. The multiple update PF exhibits faster convergence with fewer particles when compared to the conventional PF. Moreover, vehicle position estimation experiments conducted in urban environments reveal that the proposed method outperforms conventional GNSS positioning techniques, yielding more accurate position estimates.


title: Interactive Melody Generation System for Enhancing the Creativity of Musicians

abstract: This study proposes a system designed to enumerate the process of collaborative composition among humans, using automatic music composition technology. By integrating multiple Recurrent Neural Network (RNN) models, the system provides an experience akin to collaborating with several composers, thereby fostering diverse creativity. Through dynamic adaptation to the user's creative intentions, based on feedback, the system enhances its capability to generate melodies that align with user preferences and creative needs. The system's effectiveness was evaluated through experiments with composers of varying backgrounds, revealing its potential to facilitate musical creativity and suggesting avenues for further refinement. The study underscores the importance of interaction between the composer and AI, aiming to make music composition more accessible and personalized. This system represents a step towards integrating AI into the creative process, offering a new tool for composition support and collaborative artistic exploration.


title: Japanese-English Sentence Translation Exercises Dataset for Automatic Grading

abstract: This paper proposes the task of automatic assessment of Sentence Translation Exercises (STEs), that have been used in the early stage of L2 language learning. We formalize the task as grading student responses for each rubric criterion pre-specified by the educators. We then create a dataset for STE between Japanese and English including 21 questions, along with a total of 3, 498 student responses (167 on average). The answer responses were collected from students and crowd workers. Using this dataset, we demonstrate the performance of baselines including finetuned BERT and GPT models with few-shot in-context learning. Experimental results show that the baseline model with finetuned BERT was able to classify correct responses with approximately 90% in F1, but only less than 80% for incorrect responses. Furthermore, the GPT models with few-shot learning show poorer results than finetuned BERT, indicating that our newly proposed task presents a challenging issue, even for the stateof-the-art large language models.


title: Explaining Genetic Programming Trees using Large Language Models

abstract: Genetic programming (GP) has the potential to generate explainable results, especially when used for dimensionality reduction. In this research, we investigate the potential of leveraging eXplainable AI (XAI) and large language models (LLMs) like ChatGPT to improve the interpretability of GP-based non-linear dimensionality reduction. Our study introduces a novel XAI dashboard named GP4NLDR, the first approach to combine state-of-the-art GP with an LLM-powered chatbot to provide comprehensive, user-centred explanations. We showcase the system's ability to provide intuitive and insightful narratives on high-dimensional data reduction processes through case studies. Our study highlights the importance of prompt engineering in eliciting accurate and pertinent responses from LLMs. We also address important considerations around data privacy, hallucinatory outputs, and the rapid advancements in generative AI. Our findings demonstrate its potential in advancing the explainability of GP algorithms. This opens the door for future research into explaining GP models with LLMs.


title: Energetic and Control Trade-offs in Spring-Wing Systems

abstract: Flying insects are thought to achieve energy-efficient flapping flight by storing and releasing elastic energy in their muscles, tendons, and thorax. However, flight systems consisting elastic elements coupled to nonlinear, unsteady aerodynamic forces also present possible challenges to generating steady and responsive wing motions. In previous work, we examined the resonance properties of a dynamically-scaled robophysical system consisting of a rigid wing actuated by a motor in series with a spring, which we call a spring-wing system \cite{Lynch2021-ri}. In this paper, we seek to better understand the effects of perturbations on resonant systems via a non-dimensional parameter, the Weis-Fogh number. We drive a spring-wing system at a fixed resonant frequency and study the response to an internal control perturbation and an external aerodynamic perturbation with varying Weis-Fogh number. In our first experiments, we provide a step change in the input forcing amplitude and study the wing motion response. In our second experiments we provide an external fluid flow directed at the flapping wing and study the perturbed steady-state wing motion. We evaluate results across the Weis-Fogh number, which describes the ratio of inertial and aerodynamic forces and the potential energetic benefits of elastic resonance. The results suggest that spring-wing systems designed for maximum energetic efficiency also experience trade-offs in agility and stability as the Weis-Fogh number increases. Our results demonstrate that energetic efficiency and wing maneuverability are in conflict in resonant spring-wing systems suggesting that mechanical resonance presents tradeoffs in insect flight.


title: Parameterized Post-Tolman-Oppenheimer-Volkoff Framework for Screened Modified Gravity with an Application to the Secondary Component of GW190814

abstract: The secondary component of GW190814 has mass in the range $2.5$--$2.67{\rm M}_\odot$, placing it within the lower mass gap separating neutron stars from black holes. According to the predictions of general relativity and state-of-the-art nuclear equations of state, this object is too heavy to be a neutron star.~In this work, we explore the possibility that this object is a neutron star under the hypothesis that general relativity is modified to include screening mechanisms, and that the neutron star formed in an unscreened environment. We introduce a set of parameterized-post-Tolman-Oppenheimer-Volkoff (post-TOV) equations appropriate for screened modified gravity whose free parameters are environment-dependent. We find that it is possible that the GW190814 secondary could be a neutron star that formed in an unscreened environment for a range of reasonable post-TOV parameters.


title: Contrastive Learning of Person-independent Representations for Facial Action Unit Detection

abstract: Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations. In this paper, we aim to mitigate this data scarcity issue by learning AU representations from a large number of unlabelled facial videos in a contrastive learning paradigm. We formulate the self-supervised AU representation learning signals in two-fold: (1) AU representation should be frame-wisely discriminative within a short video clip; (2) Facial frames sampled from different identities but show analogous facial AUs should have consistent AU representations. As to achieve these goals, we propose to contrastively learn the AU representation within a video clip and devise a cross-identity reconstruction mechanism to learn the person-independent representations. Specially, we adopt a margin-based temporal contrastive learning paradigm to perceive the temporal AU coherence and evolution characteristics within a clip that consists of consecutive input facial frames. Moreover, the cross-identity reconstruction mechanism facilitates pushing the faces from different identities but show analogous AUs close in the latent embedding space. Experimental results on three public AU datasets demonstrate that the learned AU representation is discriminative for AU detection. Our method outperforms other contrastive learning methods and significantly closes the performance gap between the self-supervised and supervised AU detection approaches.


title: BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Proving

abstract: Artificial Intelligence for Theorem Proving has given rise to a plethora of benchmarks and methodologies, particularly in Interactive Theorem Proving (ITP). Research in the area is fragmented, with a diverse set of approaches being spread across several ITP systems. This presents a significant challenge to the comparison of methods, which are often complex and difficult to replicate. Addressing this, we present BAIT, a framework for fair and streamlined comparison of learning approaches in ITP. We demonstrate BAIT's capabilities with an in-depth comparison, across several ITP benchmarks, of state-of-the-art architectures applied to the problem of formula embedding. We find that Structure Aware Transformers perform particularly well, improving on techniques associated with the original problem sets. BAIT also allows us to assess the end-to-end proving performance of systems built on interactive environments. This unified perspective reveals a novel end-to-end system that improves on prior work. We also provide a qualitative analysis, illustrating that improved performance is associated with more semantically-aware embeddings. By streamlining the implementation and comparison of Machine Learning algorithms in the ITP context, we anticipate BAIT will be a springboard for future research.


title: Two-dimensional Kagome-in-Honeycomb materials (MN$_4$)$_3$C$_{32}$ (M=Pt or Mn)

abstract: We propose two novel two-dimensional (2D) topological materials, (PtN$_4$)$_3$C$_{32}$ and (MnN$_4$)$_3$C$_{32}$, with a special geometry that we named as kagome-in-honeycomb (KIH) lattice structure, to illustrate the coexistence of the paradigmatic states of kagome physics, Dirac fermions and flat bands, that are difficult to be simultaneously observed in three-dimensional realistic systems. In such system, MN$_4$(M=Pt or Mn) moieties are embedded in honeycomb graphene sheet according to kagome lattice structure, thereby resulting in a KIH lattice. Using the first-principles calculations, we have systemically studied the structural, electronic, and topological properties of these two materials. In the absence of spin-orbit coupling (SOC), they both exhibit the coexistence of Dirac/quadratic-crossing cone and flat band near the Fermi level. When SOC is included, a sizable topological gap is opened at the Dirac/quadratic-crossing nodal point. For nonmagnetic (PtN$_4$)$_3$C$_{32}$, the system is converted into a $\mathbb{Z}_2$ topological quantum spin Hall insulator defined on a curved Fermi level, while for ferromagnetic (MnN$_4$)$_3$C$_{32}$, the material is changed from a half-semi-metal to a quantum anomalous Hall insulator with nonzero Chern number and nontrivial chiral edge states. Our findings not only predict a new family of 2D quantum materials, but also provide an experimentally feasible platform to explore the emergent kagome physics, topological quantum Hall physics, strongly correlated phenomena, and theirs fascinating applications.


title: How habitable are M-dwarf Exoplanets? Modeling surface conditions and exploring the role of melanins in the survival of Aspergillus niger spores under exoplanet-like radiation

abstract: Exoplanet habitability remains a challenging field due to the large distances separating Earth from other stars. Using insights from biology and astrophysics, we studied the habitability of M-dwarf exoplanets by modeling their surface temperature and flare UV and X-ray doses using the Martian atmosphere as a shielding model. Analyzing the Proxima Centauri and TRAPPIST-1 systems, our models suggest that Proxima b and TRAPPIST-1 e are likeliest to have temperatures compatible with surface liquid water, as well as tolerable radiation environments. Results of the modeling were used as a basis for microbiology experiments to assess spore survival of the melanin-rich fungus Aspergillus niger to exoplanet-like radiation (UV-C and X-rays). Results showed that A. niger spores can endure superflare events on M-dwarf planets when shielded by a Mars-like atmosphere or by a thin layer of soil or water. Melanin-deficient spores suspended in a melanin-rich solution showed higher survival rates and germination efficiency when compared to melanin-free solutions. Overall, the models developed in this work establish a framework for microbiological research in habitability studies. Finally, we showed that A. niger spores can survive harsh radiation conditions of simulated exoplanets, also emphasizing the importance of multifunctional molecules like melanins in radiation shielding beyond Earth.


title: Secure Total Domination Number in Maximal Outerplanar Graphs

abstract: A subset $S$ of vertices in a graph $G$ is a secure total dominating set of $G$ if $S$ is a total dominating set of $G$ and, for each vertex $u \not\in S$, there is a vertex $v \in S$ such that $uv$ is an edge and $(S \setminus \{v\}) \cup \{u\}$ is also a total dominating set of $G$. We show that if $G$ is a maximal outerplanar graph of order $n$, then $G$ has a total secure dominating set of size at most $\lfloor 2n/3 \rfloor$. Moreover, if an outerplanar graph $G$ of order $n$, then each secure total dominating set has at least $\lceil (n+2)/3 \rceil$ vertices. We show that these bounds are best possible.


title: Causality-based Cross-Modal Representation Learning for Vision-and-Language Navigation

abstract: Vision-and-Language Navigation (VLN) has gained significant research interest in recent years due to its potential applications in real-world scenarios. However, existing VLN methods struggle with the issue of spurious associations, resulting in poor generalization with a significant performance gap between seen and unseen environments. In this paper, we tackle this challenge by proposing a unified framework CausalVLN based on the causal learning paradigm to train a robust navigator capable of learning unbiased feature representations. Specifically, we establish reasonable assumptions about confounders for vision and language in VLN using the structured causal model (SCM). Building upon this, we propose an iterative backdoor-based representation learning (IBRL) method that allows for the adaptive and effective intervention on confounders. Furthermore, we introduce the visual and linguistic backdoor causal encoders to enable unbiased feature expression for multi-modalities during training and validation, enhancing the agent's capability to generalize across different environments. Experiments on three VLN datasets (R2R, RxR, and REVERIE) showcase the superiority of our proposed method over previous state-of-the-art approaches. Moreover, detailed visualization analysis demonstrates the effectiveness of CausalVLN in significantly narrowing down the performance gap between seen and unseen environments, underscoring its strong generalization capability.


title: An EnKF-LSTM Assimilation Algorithm for Crop Growth Model

abstract: Accurate and timely prediction of crop growth is of great significance to ensure crop yields and researchers have developed several crop models for the prediction of crop growth. However, there are large difference between the simulation results obtained by the crop models and the actual results, thus in this paper, we proposed to combine the simulation results with the collected crop data for data assimilation so that the accuracy of prediction will be improved. In this paper, an EnKF-LSTM data assimilation method for various crops is proposed by combining ensemble Kalman filter and LSTM neural network, which effectively avoids the overfitting problem of existing data assimilation methods and eliminates the uncertainty of the measured data. The verification of the proposed EnKF-LSTM method and the comparison of the proposed method with other data assimilation methods were performed using datasets collected by sensor equipment deployed on a farm.


title: Human vs. Machine: Behavioral Differences Between Expert Humans and Language Models in Wargame Simulations

abstract: To some, the advent of artificial intelligence (AI) promises better decision-making and increased military effectiveness while reducing the influence of human error and emotions. However, there is still debate about how AI systems, especially large language models (LLMs), behave compared to humans in high-stakes military decision-making scenarios with the potential for increased risks towards escalation and unnecessary conflicts. To test this potential and scrutinize the use of LLMs for such purposes, we use a new wargame experiment with 107 national security experts designed to look at crisis escalation in a fictional US-China scenario and compare human players to LLM-simulated responses in separate simulations. Wargames have a long history in the development of military strategy and the response of nations to threats or attacks. Here, we show a considerable high-level agreement in the LLM and human responses and significant quantitative and qualitative differences in individual actions and strategic tendencies. These differences depend on intrinsic biases in LLMs regarding the appropriate level of violence following strategic instructions, the choice of LLM, and whether the LLMs are tasked to decide for a team of players directly or first to simulate dialog between players. When simulating the dialog, the discussions lack quality and maintain a farcical harmony. The LLM simulations cannot account for human player characteristics, showing no significant difference even for extreme traits, such as "pacifist" or "aggressive sociopath". Our results motivate policymakers to be cautious before granting autonomy or following AI-based strategy recommendations.


title: Scene Depth Estimation from Traditional Oriental Landscape Paintings

abstract: Scene depth estimation from paintings can streamline the process of 3D sculpture creation so that visually impaired people appreciate the paintings with tactile sense. However, measuring depth of oriental landscape painting images is extremely challenging due to its unique method of depicting depth and poor preservation. To address the problem of scene depth estimation from oriental landscape painting images, we propose a novel framework that consists of two-step Image-to-Image translation method with CLIP-based image matching at the front end to predict the real scene image that best matches with the given oriental landscape painting image. Then, we employ a pre-trained SOTA depth estimation model for the generated real scene image. In the first step, CycleGAN converts an oriental landscape painting image into a pseudo-real scene image. We utilize CLIP to semantically match landscape photo images with an oriental landscape painting image for training CycleGAN in an unsupervised manner. Then, the pseudo-real scene image and oriental landscape painting image are fed into DiffuseIT to predict a final real scene image in the second step. Finally, we measure depth of the generated real scene image using a pre-trained depth estimation model such as MiDaS. Experimental results show that our approach performs well enough to predict real scene images corresponding to oriental landscape painting images. To the best of our knowledge, this is the first study to measure the depth of oriental landscape painting images. Our research potentially assists visually impaired people in experiencing paintings in diverse ways. We will release our code and resulting dataset.


title: Sparse Spiking Neural Network: Exploiting Heterogeneity in Timescales for Pruning Recurrent SNN

abstract: Recurrent Spiking Neural Networks (RSNNs) have emerged as a computationally efficient and brain-inspired learning model. The design of sparse RSNNs with fewer neurons and synapses helps reduce the computational complexity of RSNNs. Traditionally, sparse SNNs are obtained by first training a dense and complex SNN for a target task, and, then, pruning neurons with low activity (activity-based pruning) while maintaining task performance. In contrast, this paper presents a task-agnostic methodology for designing sparse RSNNs by pruning a large randomly initialized model. We introduce a novel Lyapunov Noise Pruning (LNP) algorithm that uses graph sparsification methods and utilizes Lyapunov exponents to design a stable sparse RSNN from a randomly initialized RSNN. We show that the LNP can leverage diversity in neuronal timescales to design a sparse Heterogeneous RSNN (HRSNN). Further, we show that the same sparse HRSNN model can be trained for different tasks, such as image classification and temporal prediction. We experimentally show that, in spite of being task-agnostic, LNP increases computational efficiency (fewer neurons and synapses) and prediction performance of RSNNs compared to traditional activity-based pruning of trained dense models.


title: Prediction Of Cryptocurrency Prices Using LSTM, SVM And Polynomial Regression

abstract: The rapid development of information technology, especially the Internet, has facilitated users with a quick and easy way to seek information. With these convenience offered by internet services, many individuals who initially invested in gold and precious metals are now shifting into digital investments in form of cryptocurrencies. However, investments in crypto coins are filled with uncertainties and fluctuation in daily basis. This risk posed as significant challenges for coin investors that could result in substantial investment losses. The uncertainty of the value of these crypto coins is a critical issue in the field of coin investment. Forecasting, is one of the methods used to predict the future value of these crypto coins. By utilizing the models of Long Short Term Memory, Support Vector Machine, and Polynomial Regression algorithm for forecasting, a performance comparison is conducted to determine which algorithm model is most suitable for predicting crypto currency prices. The mean square error is employed as a benchmark for the comparison. By applying those three constructed algorithm models, the Support Vector Machine uses a linear kernel to produce the smallest mean square error compared to the Long Short Term Memory and Polynomial Regression algorithm models, with a mean square error value of 0.02. Keywords: Cryptocurrency, Forecasting, Long Short Term Memory, Mean Square Error, Polynomial Regression, Support Vector Machine


title: CrossNet: Leveraging Global, Cross-Band, Narrow-Band, and Positional Encoding for Single- and Multi-Channel Speaker Separation

abstract: We introduce CrossNet, a complex spectral mapping approach to speaker separation and enhancement in reverberant and noisy conditions. The proposed architecture comprises an encoder layer, a global multi-head self-attention module, a cross-band module, a narrow-band module, and an output layer. CrossNet captures global, cross-band, and narrow-band correlations in the time-frequency domain. To address performance degradation in long utterances, we introduce a random chunk positional encoding. Experimental results on multiple datasets demonstrate the effectiveness and robustness of CrossNet, achieving state-of-the-art performance in tasks including reverberant and noisy-reverberant speaker separation. Furthermore, CrossNet exhibits faster and more stable training in comparison to recent baselines. Additionally, CrossNet's high performance extends to multi-microphone conditions, demonstrating its versatility in various acoustic scenarios.


title: Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

abstract: In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution (OOD) samples, significantly increasing the risks of model misclassification and uncertainty. Our work addresses this challenge by enhancing the detection and management of OOD samples in neural networks. We introduce OOD-R (Out-of-Distribution-Rectified), a meticulously curated collection of open-source datasets with enhanced noise reduction properties. In-Distribution (ID) noise in existing OOD datasets can lead to inaccurate evaluation of detection algorithms. Recognizing this, OOD-R incorporates noise filtering technologies to refine the datasets, ensuring a more accurate and reliable evaluation of OOD detection algorithms. This approach not only improves the overall quality of data but also aids in better distinguishing between OOD and ID samples, resulting in up to a 2.5\% improvement in model accuracy and a minimum 3.2\% reduction in false positives. Furthermore, we present ActFun, an innovative method that fine-tunes the model's response to diverse inputs, thereby improving the stability of feature extraction and minimizing specificity issues. ActFun addresses the common problem of model overconfidence in OOD detection by strategically reducing the influence of hidden units, which enhances the model's capability to estimate OOD uncertainty more accurately. Implementing ActFun in the OOD-R dataset has led to significant performance enhancements, including an 18.42\% increase in AUROC of the GradNorm method and a 16.93\% decrease in FPR95 of the Energy method. Overall, our research not only advances the methodologies in OOD detection but also emphasizes the importance of dataset integrity for accurate algorithm evaluation.


title: Online Learning and Control Synthesis for Reachable Paths of Unknown Nonlinear Systems

abstract: In this paper, we present a novel method to drive a nonlinear system to a desired state, with limited a priori knowledge of its dynamic model: local dynamics at a single point and the bounds on the rate of change of these dynamics. This method synthesizes control actions by utilizing locally learned dynamics along a trajectory, based on data available up to that moment, and known proxy dynamics, which can generate an underapproximation of the unknown system's true reachable set. An important benefit to the contributions of this paper is the lack of knowledge needed to execute the presented control method. We establish sufficient conditions to ensure that a controlled trajectory reaches a small neighborhood of any provably reachable state within a short time horizon, with precision dependent on the tunable parameters of these conditions.


title: Leveraging The Finite States of Emotion Processing to Study Late-Life Mental Health

abstract: Traditional approaches in mental health research apply General Linear Models (GLM) to describe the longitudinal dynamics of observed psycho-behavioral measurements (questionnaire summary scores). Similarly, GLMs are also applied to characterize relationships between neurobiological measurements (regional fMRI signals) and perceptual stimuli or other regional signals. While these methods are useful for exploring linear correlations among the isolated signals of those constructs (i.e., summary scores or fMRI signals), these classical frameworks fall short in providing insights into the comprehensive system-level dynamics underlying observable changes. Hidden Markov Models (HMM) are a statistical model that enable us to describe the sequential relations among multiple observable constructs, and when applied through the lens of Finite State Automata (FSA), can provide a more integrated and intuitive framework for modeling and understanding the underlying controller (the prescription for how to respond to inputs) that fundamentally defines any system, as opposed to linearly correlating output signals produced by the controller. We present a simple and intuitive HMM processing pipeline vcHMM (See Preliminary Data) that highlights FSA theory and is applicable for both behavioral analysis of questionnaire data and fMRI data. HMMs offer theoretic promise as they are computationally equivalent to the FSA, the control processor of a Turing Machine (TM) The dynamic programming Viterbi algorithm is used to leverage the HMM model. It efficiently identifies the most likely sequence of hidden states. The vcHMM pipeline leverages this grammar to understand how behavior and neural activity relate to depression.


title: Competing magnetic correlations and uniaxial anisotropy in (Fe$_{1-x}$Mn$_{x}$)$_2$AlB$_2$ single crystals

abstract: We have succeeded for the first time in synthesizing single crystals of nanolaminated borides (Fe$_{1-x}$Mn$_{x}$)$_2$AlB$_2$ in the entire Fe-Mn composition range using the Al self-flux method, and have established $T$-$x$, $H$-$T$ and three-dimensional $H$-$T$-$x$ magnetic phase diagrams from the results of magnetization measurements. The ferromagnetic correlation of Fe$_2$AlB$_2$ is weakened with the Mn substitution, whereas the antiferromagnetic correlation of Mn$_2$AlB$_2$ is enhanced with the Fe up to $x=0.65$. The spin direction in the magnetic ordered states changes from the $a$ to the $b$ axis with increasing Mn concentration and temperature. At $x$ = 0.31-0.46, there are three magnetic phases; ferromagnetic, antiferromganetic, and intermediate phases in between. At $x$ = 0.65 and 0.74, a spin-flop-like metamagnetic transition was observed at a finite field parallel to the spin direction. These observations indicate that in (Fe$_{1-x}$Mn$_{x}$)$_2$AlB$_2$ the ferromagnetic and antiferromagnetic correlations coexist and the uniaxial magnetic anisotropy competes between the $a$ and $b$ axes.


title: On discrete-time polynomial dynamical systems on hypergraphs

abstract: This paper studies the stability of discrete-time polynomial dynamical systems on hypergraphs by utilizing the Perron-Frobenius theorem for nonnegative tensors with respect to the tensors Z-eigenvalues and Z-eigenvectors. Firstly, for a multilinear polynomial system on a uniform hypergraph, we study the stability of the origin of the corresponding systems. Next, we extend our results to non-homogeneous polynomial systems on non-uniform hypergraphs. We confirm that the local stability of any discrete-time polynomial system is in general dominated by pairwise terms. Assuming that the origin is locally stable, we construct a conservative (but explicit) region of attraction from the system parameters. Finally, we validate our results via some numerical examples.


title: Stimulated Raman phase shift spectroscopy: a pathway to hyperfine fingerprint spectra

abstract: The principle and experimental realization of a novel Raman spectroscopic technique entitled stimulated Raman phase shift (SRPS) spectroscopy was demonstrated. This technique depends on the measurement of the stimulated Raman scattering (SRS) induced phase shift of Stokes light field ($\Delta$ $\phi$) that is related to the real part of the third order nonlinear susceptibility of SRS. In principle, the spectral lineshape of 1/|$\Delta$ $\phi$| is a delta function waveform, which is insensitive to the fluctuation of Stokes light intensity, the decoherence of phonon in materials, as well as the inhomogeneous fluorescence background. In order to measure 1/|$\Delta$ $\phi$|, a SRPS including a Mach-Zender interferometer and a signal processing device was developed. Using the developed spectrometer, the SRPS and stimulated Raman gain (SRG) spectra of neat dimethyl sulfoxide were detected simultaneously. Seven Raman peaks corresponding to specific molecule vibrational and rotational modes were observed in the SRPS spectra, while only two peaks could be identified in the SRG spectra without a priori knowledge. The linewidth of the Raman peak centered at 2913.283 cm$^{-1}$ indicating the v$_s$(CH$_3$)stretching mode of the methyl groups was less than 0.00036 cm$^{-1}$ in the measured SRPS spectra, which was almost four orders of magnitude narrower than that in the measured SRG spectra. Meanwhile, the detection signal-to-noise ratio of the Raman peak centered at 2913.283 cm$^{-1}$ was 25.3 dB, representing an increase of 14.3 dB compared to the SRG spectra. The reliability of SRPS technique was verified by 10 independent measurements, and the standard deviation of the Raman peak frequency was less than $\pm$0.338 cm$^{-1}$ . The SRPS technique paves the way for characterizing the hyperfine fingerprint of materials.


title: An arbitrarily high order unfitted finite element method for elliptic interface problems with automatic mesh generation, Part II. Piecewise-smooth interfaces

abstract: We consider the reliable implementation of an adaptive high-order unfitted finite element method on Cartesian meshes for solving elliptic interface problems with geometrically curved singularities. We extend our previous work on the reliable cell merging algorithm for smooth interfaces to automatically generate the induced mesh for piecewise smooth interfaces. An $hp$ a posteriori error estimate is derived for a new unfitted finite element method whose finite element functions are conforming in each subdomain. Numerical examples illustrate the competitive performance of the method.


title: Negating Negatives: Alignment without Human Positive Samples via Distributional Dispreference Optimization

abstract: Large language models (LLMs) have revolutionized the role of AI, yet also pose potential risks of propagating unethical content. Alignment technologies have been introduced to steer LLMs towards human preference, gaining increasing attention. Despite notable breakthroughs in this direction, existing methods heavily rely on high-quality positive-negative training pairs, suffering from noisy labels and the marginal distinction between preferred and dispreferred response data. Given recent LLMs' proficiency in generating helpful responses, this work pivots towards a new research focus: achieving alignment using solely human-annotated negative samples, preserving helpfulness while reducing harmfulness. For this purpose, we propose Distributional Dispreference Optimization (D$^2$O), which maximizes the discrepancy between the generated responses and the dispreferred ones to effectively eschew harmful information. We theoretically demonstrate that D$^2$O is equivalent to learning a distributional instead of instance-level preference model reflecting human dispreference against the distribution of negative responses. Besides, D$^2$O integrates an implicit Jeffrey Divergence regularization to balance the exploitation and exploration of reference policies and converges to a non-negative one during training. Extensive experiments demonstrate that our method achieves comparable generation quality and surpasses the latest baselines in producing less harmful and more informative responses with better training stability and faster convergence.


title: Yet another lattice formulation of 2D $U(1)$ chiral gauge theory via bosonization

abstract: Recently, lattice formulations of Abelian chiral gauge theory in two dimensions have been devised on the basis of the Abelian bosonization. A salient feature of these 2D lattice formulations is that the gauge invariance is \emph{exactly\/} preserved for anomaly-free theories and thus is completely free from the question of the gauge mode decoupling. In the present paper, we propose a yet another lattice formulation sharing this desired property. A particularly unique point in our formulation is that the vertex operator of the dual scalar field, which carries the vector charge of the fermion and the ``magnetic charge'' in the bosonization, is represented by a ``hole'' excised from the lattice; this is the excision method formulated recently by Abe et al. in a somewhat different context.


title: LEAD: Learning Decomposition for Source-free Universal Domain Adaptation

abstract: Universal Domain Adaptation (UniDA) targets knowledge transfer in the presence of both covariate and label shifts. Recently, Source-free Universal Domain Adaptation (SF-UniDA) has emerged to achieve UniDA without access to source data, which tends to be more practical due to data protection policies. The main challenge lies in determining whether covariate-shifted samples belong to target-private unknown categories. Existing methods tackle this either through hand-crafted thresholding or by developing time-consuming iterative clustering strategies. In this paper, we propose a new idea of LEArning Decomposition (LEAD), which decouples features into source-known and -unknown components to identify target-private data. Technically, LEAD initially leverages the orthogonal decomposition analysis for feature decomposition. Then, LEAD builds instance-level decision boundaries to adaptively identify target-private data. Extensive experiments across various UniDA scenarios have demonstrated the effectiveness and superiority of LEAD. Notably, in the OPDA scenario on VisDA dataset, LEAD outperforms GLC by 3.5% overall H-score and reduces 75% time to derive pseudo-labeling decision boundaries. Besides, LEAD is also appealing in that it is complementary to most existing methods. The code is available at https://github.com/ispc-lab/LEAD.


title: A class of polynomial recurrences resulting in $(n/\log n, n/\log^2n)$-asymptotic normality

abstract: We consider sequences of polynomials that satisfy differential-difference recurrences. Polynomials satisfying such recurrences frequently appear as generating polynomials of integer valued random variables that are of interest in discrete mathematics. It is, therefore, of interest to understand the properties of such polynomials and their probabilistic consequences. We identify a class of polynomial recurrences that lead to a normal law with the expected value and the variance proportional to $n/\log n$ and $n/\log^2n$, respectively. Examples include Stirling number of the second kind and other polynomials concerning set partitions as well as polynomials related to Whitney numbers of Dowling lattices.


title: Johnson-noise-limited cancellation-free microwave impedance microscopy with monolithic silicon cantilever probes

abstract: Microwave impedance microscopy (MIM) is an emerging scanning probe technique for nanoscale complex permittivity mapping and has made significant impacts in diverse fields from semiconductors to quantum materials. To date, the most significant hurdles that limit its widespread use are the requirements of specialized microwave probes and high-precision cancellation circuits. Here we show that forgoing both elements not only is feasible but actually enhances MIM performance. Using monolithic silicon cantilever probes and a cancellation-free architecture, we demonstrate thermal Johnson-noise-limited, drift-free MIM operation with 15 nm spatial resolution, minimal topography crosstalk, and an unprecedented sensitivity of 0.26 zF/$\sqrt{\text{Hz}}$. We accomplish this by taking advantage of the high mechanical resonant frequency and spatial resolution of silicon probes, the inherent common-mode phase noise rejection of self-referenced homodyne detection, and the exceptional stability of the streamlined architecture. Our approach makes MIM drastically more accessible and paves the way for more advanced operation modes and integration with complementary techniques.


title: Generative News Recommendation

abstract: Most existing news recommendation methods tackle this task by conducting semantic matching between candidate news and user representation produced by historical clicked news. However, they overlook the high-level connections among different news articles and also ignore the profound relationship between these news articles and users. And the definition of these methods dictates that they can only deliver news articles as-is. On the contrary, integrating several relevant news articles into a coherent narrative would assist users in gaining a quicker and more comprehensive understanding of events. In this paper, we propose a novel generative news recommendation paradigm that includes two steps: (1) Leveraging the internal knowledge and reasoning capabilities of the Large Language Model (LLM) to perform high-level matching between candidate news and user representation; (2) Generating a coherent and logically structured narrative based on the associations between related news and user interests, thus engaging users in further reading of the news. Specifically, we propose GNR to implement the generative news recommendation paradigm. First, we compose the dual-level representation of news and users by leveraging LLM to generate theme-level representations and combine them with semantic-level representations. Next, in order to generate a coherent narrative, we explore the news relation and filter the related news according to the user preference. Finally, we propose a novel training method named UIFT to train the LLM to fuse multiple news articles in a coherent narrative. Extensive experiments show that GNR can improve recommendation accuracy and eventually generate more personalized and factually consistent narratives.


title: Sculpting Molecules in 3D: A Flexible Substructure Aware Framework for Text-Oriented Molecular Optimization

abstract: The integration of deep learning, particularly AI-Generated Content, with high-quality data derived from ab initio calculations has emerged as a promising avenue for transforming the landscape of scientific research. However, the challenge of designing molecular drugs or materials that incorporate multi-modality prior knowledge remains a critical and complex undertaking. Specifically, achieving a practical molecular design necessitates not only meeting the diversity requirements but also addressing structural and textural constraints with various symmetries outlined by domain experts. In this article, we present an innovative approach to tackle this inverse design problem by formulating it as a multi-modality guidance generation/optimization task. Our proposed solution involves a textural-structure alignment symmetric diffusion framework for the implementation of molecular generation/optimization tasks, namely 3DToMolo. 3DToMolo aims to harmonize diverse modalities, aligning them seamlessly to produce molecular structures adhere to specified symmetric structural and textural constraints by experts in the field. Experimental trials across three guidance generation settings have shown a superior hit generation performance compared to state-of-the-art methodologies. Moreover, 3DToMolo demonstrates the capability to generate novel molecules, incorporating specified target substructures, without the need for prior knowledge. This work not only holds general significance for the advancement of deep learning methodologies but also paves the way for a transformative shift in molecular design strategies. 3DToMolo creates opportunities for a more nuanced and effective exploration of the vast chemical space, opening new frontiers in the development of molecular entities with tailored properties and functionalities.


title: Combined optimization ghost imaging based on random speckle field

abstract: Ghost imaging is a non local imaging technology, which can obtain target information by measuring the second-order intensity correlation between the reference light field and the target detection light field. However, the current imaging environment requires a large number of measurement data, and the imaging results also have the problems of low image resolution and long reconstruction time. Therefore, using orthogonal methods such as QR decomposition, a variety of optimization methods for speckle patterns are designed combined with Kronecker product,which can help to shorten the imaging time, improve the imaging quality and image noise resistance.


title: Single Transit Detection In Kepler With Machine Learning And Onboard Spacecraft Diagnostics

abstract: Exoplanet discovery at long orbital periods requires reliably detecting individual transits without additional information about the system. Techniques like phase-folding of light curves and periodogram analysis of radial velocity data are more sensitive to planets with shorter orbital periods, leaving a dearth of planet discoveries at long periods. We present a novel technique using an ensemble of Convolutional Neural Networks incorporating the onboard spacecraft diagnostics of \emph{Kepler} to classify transits within a light curve. We create a pipeline to recover the location of individual transits, and the period of the orbiting planet, which maintains $>80\%$ transit recovery sensitivity out to an 800-day orbital period. Our neural network pipeline has the potential to discover additional planets in the \emph{Kepler} dataset, and crucially, within the $\eta$-Earth regime. We report our first candidate from this pipeline, KOI 1271.02. KOI 1271.01 is known to exhibit strong Transit Timing Variations (TTVs), and so we jointly model the TTVs and transits of both transiting planets to constrain the orbital configuration and planetary parameters and conclude with a series of potential parameters for KOI 1271.02, as there is not enough data currently to uniquely constrain the system. We conclude that KOI 1271.02 has a radius of 5.32 $\pm$ 0.20 $R_{\oplus}$ and a mass of $28.94^{0.23}_{-0.47}$ $M_{\oplus}$. Future constraints on the nature of KOI 1271.02 require measuring additional TTVs of KOI 1271.01 or observing a second transit of KOI 1271.02.


title: Detecting transitions between collective motion regimes using functional hypothesis test of the time-varying persistence homology

abstract: In a system of many similar self-propelled entities such as flocks of birds, fish school, cells and molecules, the interactions with neighbors can lead to a "coherent state", meaning the formation of visually compelling aggregation patterns due to the local adjustment of speed and direction. In this study, we explore one of the open questions that arise in studying collective patterns. When such entities, considered here as particles, tend to assume a coherent state beginning from an incoherent (random) state, what is the time interval for the transition? Also, how do model parameters affect this transition time interval? Given the observations of particle migration over a given time period as a point cloud data sampled at discrete time points, we use Topological Data Analysis, specifically persistent homology, to infer the transition time interval in which the particles undergo regime change. The topology of the particle configuration at any given time instance is captured by the persistent homology specifically Persistence Landscapes. We localize (in time) when such a transition happens by conducting the statistical significance tests namely functional hypothesis tests on persistent homology outputs corresponding to subsets of the time evolution. This process is validated on a known collective behavior model of the self-propelled particles with the regime transitions triggered by changing the model parameters in time. As an application, the developed technique was ultimately used to describe the transition in cellular movement from a disordered state to collective motion when the environment was altered.


title: Generative Explanations for Program Synthesizers

abstract: Despite great advances in program synthesis techniques, they remain algorithmic black boxes. Although they guarantee that when synthesis is successful, the implementation satisfies the specification, they provide no additional information regarding how the implementation works or the manner in which the specification is realized. One possibility to answer these questions is to use large language models (LLMs) to construct human-readable explanations. Unfortunately, experiments reveal that LLMs frequently produce nonsensical or misleading explanations when applied to the unidiomatic code produced by program synthesizers. In this paper, we develop an approach to reliably augment the implementation with explanatory names. We recover fine-grained input-output data from the synthesis algorithm to enhance the prompt supplied to the LLM, and use a combination of a program verifier and a second language model to validate the proposed explanations before presenting them to the user. Together, these techniques massively improve the accuracy of the proposed names, from 24% to 79% respectively. Through a pair of small user studies, we find that users significantly prefer the explanations produced by our technique (76% of responses indicating the appropriateness of the presenting names) to the baseline (with only 2% of responses approving of the suggestions), and that the proposed names measurably help users in understanding the synthesized implementation.


title: Discrete Consensus-Based Optimization

abstract: We propose Discrete Consensus-Based Optimization (DCBO), a fully discrete version of the Consensus-Based Optimization (CBO) framework. DCBO is a multi-agent method for the global optimization of possibly non-convex and non-differentiable functions. It aligns with the CBO paradigm, which promotes a consensus among agents towards a global optimum through simple stochastic dynamics amenable to rigorous mathematical analysis. Despite the promises, there has been a gap between the analysis of CBO and the actual behavior of the agents from its time-discrete implementation, as the former has focused on the system of continuous stochastic differential equations defining the model or its mean-field approximation. In particular, direct analysis of CBO-type algorithms with heterogeneous stochasticity is very challenging. DCBO distinguishes itself from these approaches in the sense that it has no continuous counterpart, thanks to the replacement of the "softmin" operator with the "hardmin" one, which is inherently discrete. Yet, it maintains the operational principles of CBO and allows for rich mathematical analysis. We present conditions, independent of the number of agents, for achieving a consensus or convergence and study the circumstances under which global optimization occurs. We test DCBO on a large number of benchmark functions to show its merits. We also demonstrate that DCBO is applicable to a diverse range of real-world problems, including neural network training, compressed sensing, and portfolio optimization, with competitive performance.


title: Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editing

abstract: Deep Text-to-Image Synthesis (TIS) models such as Stable Diffusion have recently gained significant popularity for creative Text-to-image generation. Yet, for domain-specific scenarios, tuning-free Text-guided Image Editing (TIE) is of greater importance for application developers, which modify objects or object properties in images by manipulating feature components in attention layers during the generation process. However, little is known about what semantic meanings these attention layers have learned and which parts of the attention maps contribute to the success of image editing. In this paper, we conduct an in-depth probing analysis and demonstrate that cross-attention maps in Stable Diffusion often contain object attribution information that can result in editing failures. In contrast, self-attention maps play a crucial role in preserving the geometric and shape details of the source image during the transformation to the target image. Our analysis offers valuable insights into understanding cross and self-attention maps in diffusion models. Moreover, based on our findings, we simplify popular image editing methods and propose a more straightforward yet more stable and efficient tuning-free procedure that only modifies self-attention maps of the specified attention layers during the denoising process. Experimental results show that our simplified method consistently surpasses the performance of popular approaches on multiple datasets.


title: Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models

abstract: Instruction Tuning has the potential to stimulate or enhance specific capabilities of large language models (LLMs). However, achieving the right balance of data is crucial to prevent catastrophic forgetting and interference between tasks. To address these limitations and enhance training flexibility, we propose the Mixture-of-LoRAs (MoA) architecture which is a novel and parameter-efficient tuning method designed for multi-task learning with LLMs. In this paper, we start by individually training multiple domain-specific LoRA modules using corresponding supervised corpus data. These LoRA modules can be aligned with the expert design principles observed in Mixture-of-Experts (MoE). Subsequently, we combine the multiple LoRAs using an explicit routing strategy and introduce domain labels to facilitate multi-task learning, which help prevent interference between tasks and ultimately enhances the performance of each individual task. Furthermore, each LoRA model can be iteratively adapted to a new domain, allowing for quick domain-specific adaptation. Experiments on diverse tasks demonstrate superior and robust performance, which can further promote the wide application of domain-specific LLMs.


title: I3DE: An IDE for Inspecting Inconsistencies in PL/SQL Code

abstract: In this paper, we introduce I3DE (Inconsistency Inspecting IDE) - an IDE plugin to inspect inconsistencies in PL/SQL code. We first observed the potential issues, e.g., misuses or bugs, that are introduced by the inconsistent understanding of PL/SQL semantics by PL/SQL programmers and DBMS developers, and propose a metamorphic testing-based approach for inspecting such inconsistencies in PL/SQL code. We design and implement our approach in I3DE, a widely usable plugin for the IntelliJ Platform. We conducted a comparative user study involving 16 participants, and the findings indicate that I3DE is consistently effective and efficient in helping programmers identify and avoid inconsistencies across different programming difficulties


title: An AI-enabled Agent-Based Model and Its Application in Measles Outbreak Simulation for New Zealand

abstract: Agent Based Models (ABMs) have emerged as a powerful tool for investigating complex social interactions, particularly in the context of public health and infectious disease investigation. In an effort to enhance the conventional ABM, enabling automated model calibration and reducing the computational resources needed for scaling up the model, we have developed a tensorized and differentiable agent-based model by coupling Graph Neural Network (GNN) and Long Short-Term Memory (LSTM) network. The model was employed to investigate the 2019 measles outbreak occurred in New Zealand, demonstrating a promising ability to accurately simulate the outbreak dynamics, particularly during the peak period of repeated cases. This paper shows that by leveraging the latest Artificial Intelligence (AI) technology and the capabilities of traditional ABMs, we gain deeper insights into the dynamics of infectious disease outbreaks. This, in turn, helps us make more informed decision when developing effective strategies that strike a balance between managing outbreaks and minimizing disruptions to everyday life.


title: VLSP 2023 -- LTER: A Summary of the Challenge on Legal Textual Entailment Recognition

abstract: In this new era of rapid AI development, especially in language processing, the demand for AI in the legal domain is increasingly critical. In the context where research in other languages such as English, Japanese, and Chinese has been well-established, we introduce the first fundamental research for the Vietnamese language in the legal domain: legal textual entailment recognition through the Vietnamese Language and Speech Processing workshop. In analyzing participants' results, we discuss certain linguistic aspects critical in the legal domain that pose challenges that need to be addressed.


title: ALMA Spectral Survey of An eruptive Young star, V883 Ori (ASSAY): I. What triggered the current episode of eruption?

abstract: An unbiased spectral survey of V883 Ori, an eruptive young star, was carried out with the Atacama Large Millimeter/submillimeter Array (ALMA) in Band 6. The detected line emission from various molecules reveals morphological/kinematical features in both the Keplerian disk and the infalling envelope. A direct infall signature, red-shifted absorption against continuum, has been detected in CO, HCO$^+$, HCN, HNC, and H$_2$CO. HCO$^+$ and SO show large arm-like structures that probably connect from an infalling envelope to the disk. HCN and H$_2$CO reveal a distinct boundary between the inner and outer disk and reveal tentative spiral structures connecting the outer disk to the inner disk. HNC shows a large central emission hole (r $\sim$0.3\arcsec) due to its chemical conversion to HCN at high temperatures. The HDO emission, a direct tracer of the water sublimation region, has been detected in the disk. Molecular emission from complex organic molecules (COMs) is confined within the HDO emission boundary, and HCO$^+$ has an emission hole in its distribution due to its destruction by water. Together, these features suggest that the current episode of eruption in V883 Ori may be triggered by the infall from the envelope to the outer disk, generating a spiral wave, which propagates inward and greatly enhances the accretion onto the central star.


title: Dark Dragon Breaks Magnetic Chain: Dynamical Substructures of IRDC G28.34 Form in Supported Environments

abstract: We have comprehensively studied the multi-scale physical properties of the infrared dark cloud (IRDC) G28.34 (the Dragon cloud) with dust polarization and molecular line data from Planck, FCRAO-14m, JCMT, and ALMA. We find that the averaged magnetic fields of clumps tend to be either parallel with or perpendicular to the cloud-scale magnetic fields, while the cores in clump MM4 tend to have magnetic fields aligned with the clump fields. Implementing the relative orientation analysis (for magnetic fields, column density gradients, and local gravity), Velocity Gradient Technique (VGT), and modified Davis-Chandrasekhar-Fermi (DCF) analysis, we find that: G28.34 is located in a trans-to-sub-Alfv\'{e}nic environment ($\mathcal{M}_{A}=0.74$ within $r=15$ pc); the magnetic field is effectively resisting gravitational collapse in large-scale diffuse gas, but is distorted by gravity within the cloud and affected by star formation activities in high-density regions; and the normalized mass-to-flux ratio tends to increase with increasing density and decreasing radius. Considering the thermal, turbulent, and magnetic supports, we find that the environmental gas of G28.34 is in a super-virial (supported) state, the infrared dark clumps may be in a near-equilibrium state, and core MM4-core4 is in a sub-virial (gravity-dominant) state. In summary, we suggest that magnetic fields dominate gravity and turbulence in the cloud environment at large scales, resulting in relatively slow cloud formation and evolution processes. Within the cloud, gravity could overwhelm magnetic fields and turbulence, allowing local dynamical star formation to happen.


title: Rabi resonance splitting phenomena in photonic integrated circuits

abstract: Realizing optical analogues of quantum phenomena in atomic, molecular, or condensed matter physics has underpinned a range of photonic technologies. Rabi splitting is a quantum phenomenon induced by a strong interaction between two quantum states, and its optical analogues are of fundamental importance for the manipulation of light-matter interactions with wide applications in optoelectronics and nonlinear optics. Here, we propose and theoretically investigate purely optical analogues of Rabi splitting in integrated waveguide-coupled resonators formed by two Sagnac interferometers. By tailoring the coherent mode interference, the spectral response of the devices is engineered to achieve optical analogues of Rabi splitting with anti-crossing behavior in the resonances. Transitions between the Lorentzian, Fano, and Rabi splitting spectral lineshapes are achieved by simply changing the phase shift along the waveguide connecting the two Sagnac interferometers, revealing interesting physical insights about the evolution of different optical analogues of quantum phenomena. The impact of the device structural parameters is also analyzed to facilitate device design and optimization. These results suggest a new way for realizing optical analogues of Rabi splitting based on integrated waveguide-coupled resonators, paving the way for many potential applications that manipulate light-matter interactions in the strong coupling regime.


title: Line defect half-indices of $SU(N)$ Chern-Simons theories

abstract: We study the Wilson line defect half-indices of 3d $\mathcal{N}=2$ supersymmetric $SU(N)$ Chern-Simons theories of level $k\le -N$ with Neumann boundary conditions for the gauge fields, together with 2d Fermi multiplets and fundamental 3d chiral multiplets to cancel the gauge anomaly. We derive some exact results and also make some conjectures based on expansions of the $q$-series. We find several interesting connections with special functions known in the literature, including Rogers-Ramanujan functions for which we conjecture integral representations, and the appearance of Appell-Lerch sums for certain Wilson line half-index grand canonical ensembles which reveal an unexpected appearance of mock modular functions. We also find intriguing $q$-difference equations relating half-indices to Wilson line half-indices. Some of these results also have a description in terms of a dual theory with Dirichlet boundary conditions for the vector multiplet in the dual theory.


title: A component-splitting implicit time integration for multicomponent reacting flows simulations

abstract: A component-splitting method is proposed to improve convergence characteristics for implicit time integration of compressible multicomponent reactive flows. The characteristic decomposition of flux jacobian of multicomponent Navier-Stokes equations yields a large sparse eigensystem, presenting challenges of slow convergence and high computational costs for implicit methods. To addresses this issue, the component-splitting method segregates the implicit operator into two parts: one for the flow equations (density/momentum/energy) and the other for the component equations. Each part's implicit operator employs flux-vector splitting based on their respective spectral radii to achieve accelerated convergence. This approach improves the computational efficiency of implicit iteration, mitigating the quadratic increase in time cost with the number of species. Two consistence corrections are developed to reduce the introduced component-splitting error and ensure the numerical consistency of mass fraction. Importantly, the impact of component-splitting method on accuracy is minimal as the residual approaches convergence. The accuracy, efficiency, and robustness of component-splitting method are thoroughly investigated and compared with the coupled implicit scheme through several numerical cases involving thermo-chemical nonequilibrium hypersonic flows. The results demonstrate that the component-splitting method decreases the required number of iteration steps for convergence of residual and wall heat flux, decreases the computation time per iteration step, and diminishes the residual to lower magnitude. The acceleration efficiency is enhanced with increases in CFL number and number of species.


title: Third-order nonlinear optical response of 2D materials in the telecom band

abstract: All-optical signal processing based on nonlinear optical devices is promising for ultrafast information processing in optical communication systems. Recent advances in two-dimensional (2D) layered materials with unique structures and distinctive properties have opened up new ave-nues for nonlinear optics and the fabrication of related devices with high performance. This paper reviews the recent advances in research on third-order optical nonlinearities of 2D materials, focus-ing on all-optical processing applications in the optical telecommunications band near 1550 nm. First, we provide an overview of the material properties of different 2D materials. Next, we review different methods for characterizing the third-order optical nonlinearities of 2D materials, including the Z-scan technique, third-harmonic generation (THG) measurement, and hybrid device character-ization, together with a summary of the measured n2 values in the telecommunications band. Fi-nally, the current challenges and future perspectives are discussed.


title: CAMASim: A Comprehensive Simulation Framework for Content-Addressable Memory based Accelerators

abstract: Content addressable memory (CAM) stands out as an efficient hardware solution for memory-intensive search operations by supporting parallel computation in memory. However, developing a CAM-based accelerator architecture that achieves acceptable accuracy, while minimizing hardware cost and catering to both exact and approximate search, still presents a significant challenge especially when considering a broader spectrum of applications. This complexity stems from CAM's rapid evolution across multiple levels--algorithms, architectures, circuits, and underlying devices. This paper introduces CAMASim, a first comprehensive CAM accelerator simulation framework, emphasizing modularity, flexibility, and generality. CAMASim establishes the detailed design space for CAM-based accelerators, incorporates automated functional simulation for accuracy, and enables hardware performance prediction, by leveraging a circuit-level CAM modeling tool. This work streamlines the design space exploration for CAM-based accelerator, aiding researchers in developing effective CAM-based accelerators for various search-intensive applications.


title: Hook restriction coefficients

abstract: Finding a combinatorial interpretation of the multiplicities of each irreducible representation of the symmetric group $S_n$ in the restriction of an irreducible polynomial representation of the general linear group $GL_n(\mathbb{C})$ remains an interesting open problem in algebraic combinatorics. In this paper we interpret the multiplicities of all irreducible representations of $S_n$ in the restriction of an irreducible polynomial representation of $GL_n(\mathbb{C})$ indexed by a hook partition.


title: Uncertainty quantification for deeponets with ensemble kalman inversion

abstract: In recent years, operator learning, particularly the DeepONet, has received much attention for efficiently learning complex mappings between input and output functions across diverse fields. However, in practical scenarios with limited and noisy data, accessing the uncertainty in DeepONet predictions becomes essential, especially in mission-critical or safety-critical applications. Existing methods, either computationally intensive or yielding unsatisfactory uncertainty quantification, leave room for developing efficient and informative uncertainty quantification (UQ) techniques tailored for DeepONets. In this work, we proposed a novel inference approach for efficient UQ for operator learning by harnessing the power of the Ensemble Kalman Inversion (EKI) approach. EKI, known for its derivative-free, noise-robust, and highly parallelizable feature, has demonstrated its advantages for UQ for physics-informed neural networks [28]. Our innovative application of EKI enables us to efficiently train ensembles of DeepONets while obtaining informative uncertainty estimates for the output of interest. We deploy a mini-batch variant of EKI to accommodate larger datasets, mitigating the computational demand due to large datasets during the training stage. Furthermore, we introduce a heuristic method to estimate the artificial dynamics covariance, thereby improving our uncertainty estimates. Finally, we demonstrate the effectiveness and versatility of our proposed methodology across various benchmark problems, showcasing its potential to address the pressing challenges of uncertainty quantification in DeepONets, especially for practical applications with limited and noisy data.


title: Evaluations and relations for finite trigonometric sums

abstract: Several methods are used to evaluate finite trigonometric sums. In each case, either the sum had not previously been evaluated, or it had been evaluated, but only by analytic means, e.g., by complex analysis or modular transformation formulas. We establish both reciprocity and three sum relations for trigonometric sums. Motivated by certain sums that we have evaluated, we add coprime conditions to the summands and thereby define analogues of Ramanujan sums, which we in turn evaluate. One of these analogues leads to a criterion for the Riemann Hypothesis, analogous to the Franel-Landau criterion.


title: Weak approximation of Schr\"odinger-F\"ollmer diffusion

abstract: We consider the weak convergence of the Euler-Maruyama approximation for Schr\"odinger-F\"ollmer diffusions, which are solutions of Schr\"odinger bridge problems and can be used for sampling from given distributions. We show that the distribution of the terminal random variable of the time-discretized process weakly converges to the target one under mild regularity conditions.


title: HDRFlow: Real-Time HDR Video Reconstruction with Large Motions

abstract: Reconstructing High Dynamic Range (HDR) video from image sequences captured with alternating exposures is challenging, especially in the presence of large camera or object motion. Existing methods typically align low dynamic range sequences using optical flow or attention mechanism for deghosting. However, they often struggle to handle large complex motions and are computationally expensive. To address these challenges, we propose a robust and efficient flow estimator tailored for real-time HDR video reconstruction, named HDRFlow. HDRFlow has three novel designs: an HDR-domain alignment loss (HALoss), an efficient flow network with a multi-size large kernel (MLK), and a new HDR flow training scheme. The HALoss supervises our flow network to learn an HDR-oriented flow for accurate alignment in saturated and dark regions. The MLK can effectively model large motions at a negligible cost. In addition, we incorporate synthetic data, Sintel, into our training dataset, utilizing both its provided forward flow and backward flow generated by us to supervise our flow network, enhancing our performance in large motion regions. Extensive experiments demonstrate that our HDRFlow outperforms previous methods on standard benchmarks. To the best of our knowledge, HDRFlow is the first real-time HDR video reconstruction method for video sequences captured with alternating exposures, capable of processing 720p resolution inputs at 25ms.


title: Kernel Correlation-Dissimilarity for Multiple Kernel k-Means Clustering

abstract: The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy by exploiting interdependencies among multiple kernels based on correlations or dissimilarities. Nevertheless, relying solely on a single metric, such as correlation or dissimilarity, to define kernel relationships introduces bias and incomplete characterization. Consequently, this limitation hinders efficient information extraction, ultimately compromising clustering performance. To tackle this challenge, we introduce a novel method that systematically integrates both kernel correlation and dissimilarity. Our approach comprehensively captures kernel relationships, facilitating more efficient classification information extraction and improving clustering performance. By emphasizing the coherence between kernel correlation and dissimilarity, our method offers a more objective and transparent strategy for extracting non-linear information and significantly improving clustering precision, supported by theoretical rationale. We assess the performance of our algorithm on 13 challenging benchmark datasets, demonstrating its superiority over contemporary state-of-the-art MKKM techniques.


title: SalienTime: User-driven Selection of Salient Time Steps for Large-Scale Geospatial Data Visualization

abstract: The voluminous nature of geospatial temporal data from physical monitors and simulation models poses challenges to efficient data access, often resulting in cumbersome temporal selection experiences in web-based data portals. Thus, selecting a subset of time steps for prioritized visualization and pre-loading is highly desirable. Addressing this issue, this paper establishes a multifaceted definition of salient time steps via extensive need-finding studies with domain experts to understand their workflows. Building on this, we propose a novel approach that leverages autoencoders and dynamic programming to facilitate user-driven temporal selections. Structural features, statistical variations, and distance penalties are incorporated to make more flexible selections. User-specified priorities, spatial regions, and aggregations are used to combine different perspectives. We design and implement a web-based interface to enable efficient and context-aware selection of time steps and evaluate its efficacy and usability through case studies, quantitative evaluations, and expert interviews.


title: Time-dependent invasion laws for a liquid-liquid displacement system

abstract: Capillary-driven flow of fluids occurs frequently in nature and has a wide range of technological applications in the fields of industry, agriculture, medicine, biotechnology, and microfluidics. By using the Onsager variational principle, we propose a model to systematically study the capillary imbibition in titled tubes, and find different laws of time-dependent capillary invasion length for liquid-liquid displacement system other than Lucas-Washburn type under different circumstances. The good agreement between our model and experimental results shows that the imbibition dynamics in a capillary tube with a prefilled liquid slug can be well captured by the dynamic equation derived in this paper. Our results bear important implications for macroscopic descriptions of multiphase flows in microfluidic systems and porous media.


title: Mechanically Designing Protected Superconducting Qubits

abstract: Significant progress is required in the engineering of large, interacting quantum systems in order to realize the promises of gate-model quantum computing. Designing such systems is challenging, as the dynamics of continuous variable quantum systems are generally unintuitive, and brute-force numerical solutions are difficult to impossible in more than a few dimensions. In this work, I draw analogies between modern superconducting qubits and mechanical mass-spring systems in attempt to gain a simple intuition for what makes each design special. In particular, I analyze superconducting qubits that are inherently protected from noise, and connect this protection to features of the corresponding mechanical system. The hope is that intuition gained from analyzing these systems mechanically will allow for intuitive design of useful superconducting circuits in the future.


title: D4C Glove-train: Solving the RPM and Bongard-logo Problem by Circumscribing and Building Distribution for Concepts

abstract: This paper achieves noteworthy progress in the realm of abstract reasoning, particularly in addressing Raven's Progressive Matrices (RPM) and Bongard-Logo challenges. Initially, we introduce Lico-Net, a novel baseline model that resolves RPM problems with remarkable accuracy. Leveraging this foundation, we advance with the D3C approach, which advocates representing the underlying concepts in abstract reasoning problems through distributions. This perspective enhances the performance of both Lico-Net and a baseline model excelling in Bongard-Logo tasks. To bolster the computational efficiency of D3C, we present the D3C-cos variant, offering a streamlined solution. Furthermore, we propose the D2C method, redefining concept boundaries within these domains and bridging the divide between high-level abstractions and their lower-dimensional counterparts. Finally, we extend our methodology to D4C, employing adversarial techniques to refine concept boundaries further and demonstrate substantial improvements in both RPM and Bongard-Logo challenges. Overall, our contributions present a fresh outlook and practical advancements in the field of abstract reasoning.


title: On Hahn-Banach smoothness and related properties in Banach spaces

abstract: In this paper, we study several variants of Hahn-Banach smoothness, viz., property-$(SU)$/$(HB)$/$(wU)$, where property-$(SU)$ and property-$(HB)$ are stronger notions and property-$(wU)$ is a weaker notion of Hahn-Banach smoothness. We characterize property-$(wU)$ and property-$(HB)$. It is observed that $L_1(\mu)$ has property-$(wU)$ in $L_1(\mu,(\mathbb{R}^2,\|.\|_2))$ but it does not have property-$(U)$ in $L_1(\mu,(\mathbb{R}^2,\|.\|_2))$ for a non-atomic measure $\mu$. We derive a sufficient condition when property-$(wU)$ is equivalent to property-$(U)$ of a subspace. It is observed that these properties are separably determined. Finally, finite-dimensional and finite co-dimensional subspaces of $c_0$, $\ell_p$ ($1\leq p<\infty$) having these properties are characterized.


title: Learning Constrained Optimization with Deep Augmented Lagrangian Methods

abstract: Learning to Optimize (LtO) is a problem setting in which a machine learning (ML) model is trained to emulate a constrained optimization solver. Learning to produce optimal and feasible solutions subject to complex constraints is a difficult task, but is often made possible by restricting the input space to a limited distribution of related problems. Most LtO methods focus on directly learning solutions to the primal problem, and applying correction schemes or loss function penalties to encourage feasibility. This paper proposes an alternative approach, in which the ML model is trained instead to predict dual solution estimates directly, from which primal estimates are constructed to form dual-feasible solution pairs. This enables an end-to-end training scheme is which the dual objective is maximized as a loss function, and solution estimates iterate toward primal feasibility, emulating a Dual Ascent method. First it is shown that the poor convergence properties of classical Dual Ascent are reflected in poor convergence of the proposed training scheme. Then, by incorporating techniques from practical Augmented Lagrangian methods, we show how the training scheme can be improved to learn highly accurate constrained optimization solvers, for both convex and nonconvex problems.


title: Robust Control Lyapunov-Value Functions for Nonlinear Disturbed Systems

abstract: Control Lyapunov Functions (CLFs) have been extensively used in the control community. A well-known drawback is the absence of a systematic way to construct CLFs for general nonlinear systems, and the problem can become more complex with input or state constraints. Our preliminary work on constructing Control Lyapunov Value Functions (CLVFs) using Hamilton-Jacobi (HJ) reachability analysis provides a method for finding a non-smooth CLF. In this paper, we extend our work on CLVFs to systems with bounded disturbance and define the Robust CLVF (R-CLVF). The R-CLVF naturally inherits all properties of the CLVF; i.e., it first identifies the "smallest robust control invariant set (SRCIS)" and stabilizes the system to it with a user-specified exponential rate. The region from which the exponential rate can be met is called the "region of exponential stabilizability (ROES)." We provide clearer definitions of the SRCIS and more rigorous proofs of several important theorems. Since the computation of the R-CLVF suffers from the "curse of dimensionality," we also provide two techniques (warmstart and system decomposition) that solve it, along with necessary proofs. Three numerical examples are provided, validating our definition of SRCIS, illustrating the trade-off between a faster decay rate and a smaller ROES, and demonstrating the efficiency of computation using warmstart and decomposition.


title: DLP-GAN: learning to draw modern Chinese landscape photos with generative adversarial network

abstract: Chinese landscape painting has a unique and artistic style, and its drawing technique is highly abstract in both the use of color and the realistic representation of objects. Previous methods focus on transferring from modern photos to ancient ink paintings. However, little attention has been paid to translating landscape paintings into modern photos. To solve such problems, in this paper, we (1) propose DLP-GAN (Draw Modern Chinese Landscape Photos with Generative Adversarial Network), an unsupervised cross-domain image translation framework with a novel asymmetric cycle mapping, and (2) introduce a generator based on a dense-fusion module to match different translation directions. Moreover, a dual-consistency loss is proposed to balance the realism and abstraction of model painting. In this way, our model can draw landscape photos and sketches in the modern sense. Finally, based on our collection of modern landscape and sketch datasets, we compare the images generated by our model with other benchmarks. Extensive experiments including user studies show that our model outperforms state-of-the-art methods.


title: Scrambling Transition in Free Fermion Systems Induced by a Single Impurity

abstract: In quantum many-body systems, interactions play a crucial role in the emergence of information scrambling. When particles interact throughout the system, the entanglement between them can lead to a rapid and chaotic spreading of quantum information, typically probed by the growth in operator size in the Heisenberg picture. In this study, we explore whether the operator undergoes scrambling when particles interact solely through a single impurity in generic spatial dimensions, focusing on fermion systems with spatial and temporal random hoppings. By connecting the dynamics of the operator to the symmetric exclusion process with a source term, we demonstrate the presence of an escape-to-scrambling transition when tuning the interaction strength for fermions in three dimensions. As a comparison, systems in lower dimensions are proven to scramble at arbitrarily weak interactions unless the hopping becomes sufficiently long-ranged. Our predictions are validated using both a Brownian circuit with a single Majorana fermion per site and a solvable Brownian SYK model with a large local Hilbert space dimension. This suggests the universality of the theoretical picture for free fermion systems with spatial and temporal randomness.


title: Slot Abstractors: Toward Scalable Abstract Visual Reasoning

abstract: Abstract visual reasoning is a characteristically human ability, allowing the identification of relational patterns that are abstracted away from object features, and the systematic generalization of those patterns to unseen problems. Recent work has demonstrated strong systematic generalization in visual reasoning tasks involving multi-object inputs, through the integration of slot-based methods used for extracting object-centric representations coupled with strong inductive biases for relational abstraction. However, this approach was limited to problems containing a single rule, and was not scalable to visual reasoning problems containing a large number of objects. Other recent work proposed Abstractors, an extension of Transformers that incorporates strong relational inductive biases, thereby inheriting the Transformer's scalability and multi-head architecture, but it has yet to be demonstrated how this approach might be applied to multi-object visual inputs. Here we combine the strengths of the above approaches and propose Slot Abstractors, an approach to abstract visual reasoning that can be scaled to problems involving a large number of objects and multiple relations among them. The approach displays state-of-the-art performance across four abstract visual reasoning tasks, as well as an abstract reasoning task involving real-world images.


title: TGPT-PINN: Nonlinear model reduction with transformed GPT-PINNs

abstract: We introduce the Transformed Generative Pre-Trained Physics-Informed Neural Networks (TGPT-PINN) for accomplishing nonlinear model order reduction (MOR) of transport-dominated partial differential equations in an MOR-integrating PINNs framework. Building on the recent development of the GPT-PINN that is a network-of-networks design achieving snapshot-based model reduction, we design and test a novel paradigm for nonlinear model reduction that can effectively tackle problems with parameter-dependent discontinuities. Through incorporation of a shock-capturing loss function component as well as a parameter-dependent transform layer, the TGPT-PINN overcomes the limitations of linear model reduction in the transport-dominated regime. We demonstrate this new capability for nonlinear model reduction in the PINNs framework by several nontrivial parametric partial differential equations.


title: Foot Shape-Dependent Resistive Force Model for Bipedal Walkers on Granular Terrains

abstract: Legged robots have demonstrated high efficiency and effectiveness in unstructured and dynamic environments. However, it is still challenging for legged robots to achieve rapid and efficient locomotion on deformable, yielding substrates, such as granular terrains. We present an enhanced resistive force model for bipedal walkers on soft granular terrains by introducing effective intrusion depth correction. The enhanced force model captures fundamental kinetic results considering the robot foot shape, walking gait speed variation, and energy expense. The model is validated by extensive foot intrusion experiments with a bipedal robot. The results confirm the model accuracy on the given type of granular terrains. The model can be further integrated with the motion control of bipedal robotic walkers.


title: A Density-Guided Temporal Attention Transformer for Indiscernible Object Counting in Underwater Video

abstract: Dense object counting or crowd counting has come a long way thanks to the recent development in the vision community. However, indiscernible object counting, which aims to count the number of targets that are blended with respect to their surroundings, has been a challenge. Image-based object counting datasets have been the mainstream of the current publicly available datasets. Therefore, we propose a large-scale dataset called YoutubeFish-35, which contains a total of 35 sequences of high-definition videos with high frame-per-second and more than 150,000 annotated center points across a selected variety of scenes. For benchmarking purposes, we select three mainstream methods for dense object counting and carefully evaluate them on the newly collected dataset. We propose TransVidCount, a new strong baseline that combines density and regression branches along the temporal domain in a unified framework and can effectively tackle indiscernible object counting with state-of-the-art performance on YoutubeFish-35 dataset.


title: Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots

abstract: For robots to perform assistive tasks in unstructured home environments, they must learn and reason on the semantic knowledge of the environments. Despite a resurgence in the development of semantic reasoning architectures, these methods assume that all the training data is available a priori. However, each user's environment is unique and can continue to change over time, which makes these methods unsuitable for personalized home service robots. Although research in continual learning develops methods that can learn and adapt over time, most of these methods are tested in the narrow context of object classification on static image datasets. In this paper, we combine ideas from continual learning, semantic reasoning, and interactive machine learning literature and develop a novel interactive continual learning architecture for continual learning of semantic knowledge in a home environment through human-robot interaction. The architecture builds on core cognitive principles of learning and memory for efficient and real-time learning of new knowledge from humans. We integrate our architecture with a physical mobile manipulator robot and perform extensive system evaluations in a laboratory environment over two months. Our results demonstrate the effectiveness of our architecture to allow a physical robot to continually adapt to the changes in the environment from limited data provided by the users (experimenters), and use the learned knowledge to perform object fetching tasks.