title: SpaceYOLO: A Human-Inspired Model for Real-time, On-board Spacecraft Feature Detection

abstract: The rapid proliferation of non-cooperative spacecraft and space debris in orbit has precipitated a surging demand for on-orbit servicing and space debris removal at a scale that only autonomous missions can address, but the prerequisite autonomous navigation and flightpath planning to safely capture an unknown, non-cooperative, tumbling space object is an open problem. This requires algorithms for real-time, automated spacecraft feature recognition to pinpoint the locations of collision hazards (e.g. solar panels or antennas) and safe docking features (e.g. satellite bodies or thrusters) so safe, effective flightpaths can be planned. Prior work in this area reveals the performance of computer vision models are highly dependent on the training dataset and its coverage of scenarios visually similar to the real scenarios that occur in deployment. Hence, the algorithm may have degraded performance under certain lighting conditions even when the rendezvous maneuver conditions of the chaser to the target spacecraft are the same. This work delves into how humans perform these tasks through a survey of how aerospace engineering students experienced with spacecraft shapes and components recognize features of the three spacecraft: Landsat, Envisat, Anik, and the orbiter Mir. The survey reveals that the most common patterns in the human detection process were to consider the shape and texture of the features: antennas, solar panels, thrusters, and satellite bodies. This work introduces a novel algorithm SpaceYOLO, which fuses a state-of-the-art object detector YOLOv5 with a separate neural network based on these human-inspired decision processes exploiting shape and texture. Performance in autonomous spacecraft detection of SpaceYOLO is compared to ordinary YOLOv5 in hardware-in-the-loop experiments under different lighting and chaser maneuver conditions at the ORION Laboratory at Florida Tech.


title: Chiral restoration of nucleons in neutron star matter: studies based on a parity doublet model

abstract: We review the chiral variant and invariant components of nucleon masses and its consequence on the chiral restoration in extreme conditions, neutron star matter in particular. We consider a model of linear realization of chiral symmetry with the nucleon parity doublet structure that permits the chiral invariant mass, $m_0$, for positive and negative parity nucleons. Nuclear matter is constructed with the parity doublet nucleon model coupled to scalar fields $\sigma$, vector fields $(\omega, \rho)$, and to mesons with strangeness through the U(1)$_A$ anomaly. In models with large $m_0$, the nucleon mass is insensitive to the medium, and the nuclear saturation properties can be reproduced without demanding strong couplings of nucleons to scalar fields $\sigma$ and vector fields $\omega$. We confront the resulting nuclear equations of state with nuclear constraints and neutron star observations, and delineate the chiral invariant mass and effective interactions. To further examine nuclear equations of state beyond the saturation density, we supplement quark models to set the boundary conditions from the high density side. The quark models are constrained by the two-solar mass conditions, and such constraints are transferred to nuclear models through the causality and thermodynamic stability conditions. We also calculate various condensates and matter composition from nuclear to quark matter in a unified matter, by constructing a generating functional that interpolates nuclear and quark matter with external fields. Two types of chiral restoration are discussed; the one due to the positive scalar charges of nucleons, and the other triggered by the evolution of the Dirac sea. We found the U(1)$_A$ anomaly softens equations of state from low to high density.


title: Existence of exact solution of the Susceptible-Exposed-Infectious-Recovered (SEIR) epidemic model

abstract: Exact solutions of the SEIR epidemic model are derived, and various properties of solutions are obtained directly from the exact solution. In this paper Abel differential equations play an important role in establishing the exact solution of SEIR differential system, in particular the number of infected individuals can be represented in a simple form by using a positive solution of an Abel differential equation. It is shown that the parametric form of the exact solution satisfies some linear differential system including a positive solution of an Abel differential equation.


title: Including stress relaxation in point-process model for seismic occurrence

abstract: Physics-based and statistic-based models for describing seismic occurrence are two sides of the same coin. In this article we compare the temporal organization of events obtained in a spring-block model for the seismic fault with the one predicted by probabilistic models for seismic occurrence. Thanks to the optimization of the parameters, by means of a Maximum Likelihood Estimation, it is possible to identify the statistical model which fits better the physical one. The results show that the best statistical model must take into account the non trivial interplay between temporal clustering, related to aftershock occurrence, and the stress discharge following the occurrence of high magnitude mainshocks. The two mechanisms contribute in different ways according to the minimum magnitude considered in the data fitting catalog.


title: Analysis of Biomass Sustainability Indicators from a Machine Learning Perspective

abstract: Plant biomass estimation is critical due to the variability of different environmental factors and crop management practices associated with it. The assessment is largely impacted by the accurate prediction of different environmental sustainability indicators. A robust model to predict sustainability indicators is a must for the biomass community. This study proposes a robust model for biomass sustainability prediction by analyzing sustainability indicators using machine learning models. The prospect of ensemble learning was also investigated to analyze the regression problem. All experiments were carried out on a crop residue data from the Ohio state. Ten machine learning models, namely, linear regression, ridge regression, multilayer perceptron, k-nearest neighbors, support vector machine, decision tree, gradient boosting, random forest, stacking and voting, were analyzed to estimate three biomass sustainability indicators, namely soil erosion factor, soil conditioning index, and organic matter factor. The performance of the model was assessed using cross-correlation (R2), root mean squared error and mean absolute error metrics. The results showed that Random Forest was the best performing model to assess sustainability indicators. The analyzed model can now serve as a guide for assessing sustainability indicators in real time.


title: Stochastic discrete dynamical model for the hydrodynamic analog of a quantum mirage

abstract: Recently discrete dynamical models of walking droplet dynamics have allowed for fast numerical simulations of their horizontal chaotic motion and consequently the long-time statistical distribution of the droplet position. We develop a discrete model for walkers on an elliptical corral with two dominant eigenmodes. These eigenmodes are excited periodically with each having random, but correlated, weights. At each iteration the model computes the horizontal propulsion of the droplet due to impacts with the fluid bath. The propulsion is calculated based on the interaction of the droplet with the wavefield produced by the eigenmode excitations. We record the long-time statistics, and incredibly for such a simple model, they are qualitatively similar to that of experiments.

categories: math.DS nlin.CD physics.class-ph physics.flu-dyn


title: A note on connectedness of Blaschke products

abstract: Consider the space $\mathcal{F}$ of all inner functions on the unit open disk under the uniform topology, which is a metric topology induced by the $H^{\infty}$-norm. In the present paper, a class of Blaschke products, denoted by $\mathcal{H}_{SC}$, is introduced. We prove that for each $B\in\mathcal{H}_{SC}$, $B$ and $zB$ belong to the same path-connected component of $\mathcal{F}$. It plays an important role of a method to select a fine subsequence of zeros. As a byproduct, we obtain that each Blaschke product in $\mathcal{H}_{SC}$ has an interpolating and one-component factor.


title: A remark of the number of quasi-hereditary structures

abstract: Dlab and Ringel showed that algebras being quasi-hereditary in all total orders for indices of primitive idempotents becomes hereditary. So, we are interested in for which orders a given quasi-hereditary algebra is again quasi-hereditary. As a matter of fact, we consider permutations of indices instead of total orders. If the standard modules defined by two permutations coincide, we say that the permutations are equivalent. Moreover if the algebra with permuted indices is quasi-hereditary, then this equivalence class of the permutation is called a quasi-hereditary structure. In this article, we give a method of counting the number of quasi-hereditary structures for certain algebras.


title: Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot

abstract: Informed consent is a core cornerstone of ethics in human subject research. Through the informed consent process, participants learn about the study procedure, benefits, risks, and more to make an informed decision. However, recent studies showed that current practices might lead to uninformed decisions and expose participants to unknown risks, especially in online studies. Without the researcher's presence and guidance, online participants must read a lengthy form on their own with no answers to their questions. In this paper, we examined the role of an AI-powered chatbot in improving informed consent online. By comparing the chatbot with form-based interaction, we found the chatbot improved consent form reading, promoted participants' feelings of agency, and closed the power gap between the participant and the researcher. Our exploratory analysis further revealed the altered power dynamic might eventually benefit study response quality. We discussed design implications for creating AI-powered chatbots to offer effective informed consent in broader settings.


title: RobustNeRF: Ignoring Distractors with Robust Losses

abstract: Neural radiance fields (NeRF) excel at synthesizing new views given multi-view, calibrated images of a static scene. When scenes include distractors, which are not persistent during image capture (moving objects, lighting variations, shadows), artifacts appear as view-dependent effects or 'floaters'. To cope with distractors, we advocate a form of robust estimation for NeRF training, modeling distractors in training data as outliers of an optimization problem. Our method successfully removes outliers from a scene and improves upon our baselines, on synthetic and real-world scenes. Our technique is simple to incorporate in modern NeRF frameworks, with few hyper-parameters. It does not assume a priori knowledge of the types of distractors, and is instead focused on the optimization problem rather than pre-processing or modeling transient objects. More results on our page https://robustnerf.github.io/public.


title: Sharp Lower Bounds on Interpolation by Deep ReLU Neural Networks at Irregularly Spaced Data

abstract: We study the interpolation power of deep ReLU neural networks. Specifically, we consider the question of how efficiently, in terms of the number of parameters, deep ReLU networks can interpolate values at $N$ datapoints in the unit ball which are separated by a distance $\delta$. We show that $\Omega(N)$ parameters are required in the regime where $\delta$ is exponentially small in $N$, which gives the sharp result in this regime since $O(N)$ parameters are always sufficient. This also shows that the bit-extraction technique used to prove lower bounds on the VC dimension cannot be applied to irregularly spaced datapoints. Finally, as an application we give a lower bound on the approximation rates that deep ReLU neural networks can achieve for Sobolev spaces at the embedding endpoint.


title: Diminimal families of arbitrary diameter

abstract: Given a tree $T$, let $q(T)$ be the minimum number of distinct eigenvalues in a symmetric matrix whose underlying graph is $T$. It is well known that $q(T)\geq d(T)+1$, where $d(T)$ is the diameter of $T$, and a tree $T$ is said to be diminimal if $q(T)=d(T)+1$. In this paper, we present families of diminimal trees of any fixed diameter. Our proof is constructive, allowing us to compute, for any diminimal tree $T$ of diameter $d$ in these families, a symmetric matrix $M$ with underlying graph $T$ whose spectrum has exactly $d+1$ distinct eigenvalues.


title: Improving Rare Words Recognition through Homophone Extension and Unified Writing for Low-resource Cantonese Speech Recognition

abstract: Homophone characters are common in tonal syllable-based languages, such as Mandarin and Cantonese. The data-intensive end-to-end Automatic Speech Recognition (ASR) systems are more likely to mis-recognize homophone characters and rare words under low-resource settings. For the problem of lowresource Cantonese speech recognition, this paper presents a novel homophone extension method to integrate human knowledge of the homophone lexicon into the beam search decoding process with language model re-scoring. Besides, we propose an automatic unified writing method to merge the variants of Cantonese characters and standardize speech annotation guidelines, which enables more efficient utilization of labeled utterances by providing more samples for the merged characters. We empirically show that both homophone extension and unified writing improve the recognition performance significantly on both in-domain and out-of-domain test sets, with an absolute Character Error Rate (CER) decrease of around 5% and 18%.


title: SHINE: Deep Learning-Based Accessible Parking Management System

abstract: The ongoing expansion of urban areas facilitated by advancements in science and technology has resulted in a considerable increase in the number of privately owned vehicles worldwide, including in South Korea. However, this gradual increment in the number of vehicles has inevitably led to parking-related issues, including the abuse of disabled parking spaces (hereafter referred to as accessible parking spaces) designated for individuals with disabilities. Traditional license plate recognition (LPR) systems have proven inefficient in addressing such a problem in real-time due to the high frame rate of surveillance cameras, the presence of natural and artificial noise, and variations in lighting and weather conditions that impede detection and recognition by these systems. With the growing concept of parking 4.0, many sensors, IoT and deep learning-based approaches have been applied to automatic LPR and parking management systems. Nonetheless, the studies show a need for a robust and efficient model for managing accessible parking spaces in South Korea. To address this, we have proposed a novel system called, Shine, which uses the deep learning-based object detection algorithm for detecting the vehicle, license plate, and disability badges (referred to as cards, badges, or access badges hereafter) and verifies the rights of the driver to use accessible parking spaces by coordinating with the central server. Our model, which achieves a mean average precision of 92.16%, is expected to address the issue of accessible parking space abuse and contributes significantly towards efficient and effective parking management in urban environments.


title: Nonlinear Regge trajectories and saturation of the Hagedorn spectrum

abstract: We argue that two seemingly different phenomena, namely the well-known saturation of the Hagedorn exponential distribution and the less familiar saturation of Regge trajectories at resonance masses $m\approx$ 2-2.5 GeV are related and have the same origin: quark deconfinement. We show that the slope of the real part of non-linear Regge trajectories determines the prefactor $f(m)$ in Hagedorn's resonance mass density distribution $\rho(m)$. While the Hagedorn distribution comes from statistics, Regge trajectories contain dynamics.


title: Fast Online Value-Maximizing Prediction Sets with Conformal Cost Control

abstract: Many real-world multi-label prediction problems involve set-valued predictions that must satisfy specific requirements dictated by downstream usage. We focus on a typical scenario where such requirements, separately encoding $\textit{value}$ and $\textit{cost}$, compete with each other. For instance, a hospital might expect a smart diagnosis system to capture as many severe, often co-morbid, diseases as possible (the value), while maintaining strict control over incorrect predictions (the cost). We present a general pipeline, dubbed as FavMac, to maximize the value while controlling the cost in such scenarios. FavMac can be combined with almost any multi-label classifier, affording distribution-free theoretical guarantees on cost control. Moreover, unlike prior works, it can handle real-world large-scale applications via a carefully designed online update mechanism, which is of independent interest. Our methodological and theoretical contributions are supported by experiments on several healthcare tasks and synthetic datasets - FavMac furnishes higher value compared with several variants and baselines while maintaining strict cost control. Our code is available at https://github.com/zlin7/FavMac


title: Universal Difference-in-Differences for Causal Inference in Epidemiology

abstract: Difference-in-differences is undoubtedly one of the most widely used methods for evaluating the causal effect of an intervention in observational (i.e., nonrandomized) settings. The approach is typically used when pre- and post-exposure outcome measurements are available, and one can reasonably assume that the association of the unobserved confounder with the outcome has the same absolute magnitude in the two exposure arms, and is constant over time; a so-called parallel trends assumption. The parallel trends assumption may not be credible in many practical settings, including if the outcome is binary, a count, or polytomous, as well as when an uncontrolled confounder exhibits non-additive effects on the distribution of the outcome, even if such effects are constant over time. We introduce an alternative approach that replaces the parallel trends assumption with an odds ratio equi-confounding assumption under which an association between treatment and the potential outcome under no-treatment is identified with a well-specified generalized linear model relating the pre-exposure outcome and the exposure. Because the proposed method identifies any causal effect that is conceivably identified in the absence of confounding bias, including nonlinear effects such as quantile treatment effects, the approach is aptly called Universal Difference-in-differences (UDiD). Both fully parametric and more robust semiparametric UDiD estimators are described and illustrated in a real-world application concerning the causal effects of a Zika virus outbreak on birth rate in Brazil.


title: Longitudinal Canonical Correlation Analysis

abstract: This paper considers canonical correlation analysis for two longitudinal variables that are possibly sampled at different time resolutions with irregular grids. We modeled trajectories of the multivariate variables using random effects and found the most correlated sets of linear combinations in the latent space. Our numerical simulations showed that the longitudinal canonical correlation analysis effectively recovers underlying correlation patterns between two high-dimensional longitudinal data sets. We applied the proposed LCCA to data from the Alzheimer's Disease Neuroimaging Initiative and identified the longitudinal profiles of morphological brain changes and amyloid cumulation.


title: Effective Random Test Generation for Deep Learning Compilers

abstract: Deep learning compilers help address difficulties of deploying deep learning models on diverse types of hardware. Testing deep learning compilers is highly crucial, because they are impacting countless AI applications that use them for model optimization and deployment. To test deep learning compilers, random testing, being popularly used for compiler testing practices, faces the challenge of generating semantically valid test inputs, i.e., deep learning models that satisfy the semantic model specifications (in short as semantic specifications). To tackle this challenge, in this paper, we propose a novel approach named Isra, including a domain-specific constraint solver that resolves the constraints from the semantic specifications without backtracking. We implement and apply our approach on three popular real-world deep learning compilers including TVM, Glow, and a commercial compiler. The evaluation results show that Isra is more effective than the state-of-the-art approaches and the baseline approaches on constructing valid test inputs for compiler-bug detection, and Isra successfully finds 24 previously unknown bugs in released versions of the three compilers. These results indicate effectiveness and practical value of Isra.


title: Computational Dualism and Objective Superintelligence

abstract: The concept of intelligent software is flawed. The behaviour of software is determined by the hardware that "interprets" it. This undermines claims regarding the behaviour of theorised, software superintelligence. Here we characterise this problem as "computational dualism", where instead of mental and physical substance, we have software and hardware. We argue that to make objective claims regarding performance we must avoid computational dualism. We propose a pancomputational alternative wherein every aspect of the environment is a relation between irreducible states. We formalise systems as behaviour (inputs and outputs), and cognition as embodied, embedded, extended and enactive. The result is cognition formalised as a part of the environment, rather than as a disembodied policy interacting with the environment through an interpreter. This allows us to make objective claims regarding intelligence, which we argue is the ability to "generalise", identify causes and adapt. We then establish objective upper bounds for intelligent behaviour. This suggests AGI will be safer, but more limited, than theorised.


title: High-entropy silicide superconductors with W$_{5}$Si$_{3}$-type structure

abstract: We report the synthesis, crystal structure and physical properties of two new high-entropy silicides (HESs), namely (Nb$_{0.1}$Mo$_{0.3}$W$_{0.3}$Re$_{0.2}$Ru$_{0.1}$)$_{5}$Si$_{3}$ and (Nb$_{0.2}$Mo$_{0.3}$W$_{0.3}$Re$_{0.1}$Ru$_{0.1}$)$_{5}$Si$_{3}$. Structural analysis indicates that both HESs consist of a (nearly) single tetragonal W$_{5}$Si$_{3}$-type phase (space group $I$4/$mcm$) with a disordered cation distribution. Electrical resistivity, magnetic susceptibility and specific heat measurements show that (Nb$_{0.1}$Mo$_{0.3}$W$_{0.3}$Re$_{0.2}$Ru$_{0.1}$)$_{5}$Si$_{3}$ and (Nb$_{0.2}$Mo$_{0.3}$W$_{0.3}$Re$_{0.1}$Ru$_{0.1}$)$_{5}$Si$_{3}$ are weakly coupled bulk superconductors, which represent the first superconducting high-entropy nonoxide ceramics. In particular, these HESs have higher $T_{\rm c}$ values (3.2-3.3 K) compared with those of the binary counterparts, and their $B_{\rm c2}$(0)/$T_{\rm c}$ ratios are the largest among superconductors of the same structural type.


title: Coordinating Distributed Example Orders for Provably Accelerated Training

abstract: Recent research on online Gradient Balancing (GraB) has revealed that there exist permutation-based example orderings for SGD that are guaranteed to outperform random reshuffling (RR). Whereas RR arbitrarily permutes training examples, GraB leverages stale gradients from prior epochs to order examples -- achieving a provably faster convergence rate than RR. However, GraB is limited by design: while it demonstrates an impressive ability to scale-up training on centralized data, it does not naturally extend to modern distributed ML workloads. We therefore propose Coordinated Distributed GraB (CD-GraB), which uses insights from prior work on kernel thinning to translate the benefits of provably faster permutation-based example ordering to distributed settings. With negligible overhead, CD-GraB exhibits a linear speedup in convergence rate over centralized GraB and outperforms distributed RR on a variety of benchmark tasks.


title: A time-dependent Markovian model of a limit order book

abstract: This paper considers a Markovian model of a limit order book where time-dependent rates are allowed. With the objective of understanding the mechanisms through which a microscopic model of an orderbook can converge to more general diffusion than a Brownian motion with constant coefficient, a simple time-dependent model is proposed. The model considered here starts by describing the processes that govern the arrival of the different orders such as limit orders, market orders and cancellations. In this sense, this is a microscopic model rather than a ``mesoscopic'' model where the starting point is usually the point processes describing the times at which the price changes occur and aggregate in these all the information pertaining to the arrival of individual orders. Furthermore, several empirical studies are performed to shed some light into the validity of the modeling assumptions and to verify whether certain stocks satisfy the conditions for their price process to converge to a more complex diffusion.


title: Low-Complexity Precoding for Extremely Large-Scale MIMO Over Non-Stationary Channels

abstract: Extremely large-scale multiple-input-multiple-output (XL-MIMO) is a promising technology for the future sixth-generation (6G) networks to achieve higher performance. In practice, various linear precoding schemes, such as zero-forcing (ZF) and regularized zero-forcing (RZF) precoding, are capable of achieving both large spectral efficiency (SE) and low bit error rate (BER) in traditional massive MIMO (mMIMO) systems. However, these methods are not efficient in extremely large-scale regimes due to the inherent spatial non-stationarity and high computational complexity. To address this problem, we investigate a low-complexity precoding algorithm, e.g., randomized Kaczmarz (rKA), taking into account the spatial non-stationary properties in XL-MIMO systems. Furthermore, we propose a novel mode of randomization, i.e., sampling without replacement rKA (SwoR-rKA), which enjoys a faster convergence speed than the rKA algorithm. Besides, the closed-form expression of SE considering the interference between subarrays in downlink XL-MIMO systems is derived. Numerical results show that the complexity given by both rKA and SwoR-rKA algorithms has 51.3% reduction than the traditional RZF algorithm with similar SE performance. More importantly, our algorithms can effectively reduce the BER when the transmitter has imperfect channel estimation.


title: Causal Effect Estimation: Recent Advances, Challenges, and Opportunities

abstract: Causal inference has numerous real-world applications in many domains, such as health care, marketing, political science, and online advertising. Treatment effect estimation, a fundamental problem in causal inference, has been extensively studied in statistics for decades. However, traditional treatment effect estimation methods may not well handle large-scale and high-dimensional heterogeneous data. In recent years, an emerging research direction has attracted increasing attention in the broad artificial intelligence field, which combines the advantages of traditional treatment effect estimation approaches (e.g., propensity score, matching, and reweighing) and advanced machine learning approaches (e.g., representation learning, adversarial learning, and graph neural networks). Although the advanced machine learning approaches have shown extraordinary performance in treatment effect estimation, it also comes with a lot of new topics and new research questions. In view of the latest research efforts in the causal inference field, we provide a comprehensive discussion of challenges and opportunities for the three core components of the treatment effect estimation task, i.e., treatment, covariates, and outcome. In addition, we showcase the promising research directions of this topic from multiple perspectives.


title: Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent

abstract: It is well known that the finite step-size ($h$) in Gradient Descent (GD) implicitly regularizes solutions to flatter minima. A natural question to ask is "Does the momentum parameter $\beta$ play a role in implicit regularization in Heavy-ball (H.B) momentum accelerated gradient descent (GD+M)?". To answer this question, first, we show that the discrete H.B momentum update (GD+M) follows a continuous trajectory induced by a modified loss, which consists of an original loss and an implicit regularizer. Then, we show that this implicit regularizer for (GD+M) is stronger than that of (GD) by factor of $(\frac{1+\beta}{1-\beta})$, thus explaining why (GD+M) shows better generalization performance and higher test accuracy than (GD). Furthermore, we extend our analysis to the stochastic version of gradient descent with momentum (SGD+M) and characterize the continuous trajectory of the update of (SGD+M) in a pointwise sense. We explore the implicit regularization in (SGD+M) and (GD+M) through a series of experiments validating our theory.


title: Evolving the COLA software library

abstract: COLA is a software library for lattice QCD, written in a combination of modern Fortran and C/C++. Intel and NVIDIA have dominated the HPC domain in the years leading up to the exascale era, but the status quo has changed with the arrival of Frontier and other AMD-based systems in the supercomputing Top 500. Setonix is a next generation HPE Cray EX system hosted at the Pawsey Supercomputing Centre in Perth, Australia. Setonix features AMD EPYC CPUs and AMD Instinct GPUs. This report describes some of my experiences in evolving COLA to adapt to the current hardware landscape.


title: Rainbow triangles sharing one common vertex or edge

abstract: Let $G$ be an edge-colored graph on $n$ vertices. For a vertex $v$, the \emph{color degree} of $v$ in $G$, denoted by $d^c(v)$, is the number of colors appearing on the edges incident with $v$. Denote by $\delta^c(G)=\min\{d^c(v):v\in V(G)\}$. By a theorem of H. Li, an $n$-vertex edge-colored graph $G$ contains a rainbow triangle if $\delta^c(G)\geq \frac{n+1}{2}$. Inspired by this result, we consider two related questions concerning edge-colored books and friendship subgraphs of edge-colored graphs. Let $k\geq 2$ be a positive integer. We prove that if $\delta^c(G)\geq \frac{n+k-1}{2}$ where $n\geq 3k-2$, then $G$ contains $k$ rainbow triangles sharing one common edge; and if $\delta^c(G)\geq \frac{n+2k-3}{2}$ where $n\geq 2k+9$, then $G$ contains $k$ rainbow triangles sharing one common vertex. The special case $k=2$ of both results improves H. Li's theorem. The main novelty of our proof of the first result is a combination of the recent new technique for finding rainbow cycles due to Czygrinow, Molla, Nagle, and Oursler and some recent counting technique from \cite{LNSZ}. The proof of the second result is with the aid of the machine implicitly in the work of Tur\'an numbers for matching numbers due to Erd\H{o}s and Gallai.


title: Quartic locality of higher-spin gravity in de Sitter and Euclidean anti-de Sitter space

abstract: We consider higher-spin gravity in (A)dS_4, defined as the holographic dual of a free O(N) or Sp(N) vector model. At the quartic level, this theory has been judged non-local at distances greater than the (A)dS radius, due to a mismatch of massless (twist=1) exchange-type terms in its boundary OPE behavior. We review the non-locality argument, and note that it relies on a double-lightcone limit, which requires a Lorentzian boundary. In the Euclidean OPE limit, we demonstrate the absence of massless exchange-type non-localities of any spin, by inspecting a known formula for the bulk exchange diagrams in Euclidean AdS, and constructing upper bounds in which the spin-dependence factorizes from the position-dependence. Our results suggest that higher-spin theory is local (at distances greater than the curvature radius) in spacetimes with Euclidean boundary signature. For Lorentzian bulk, this implies locality in de Sitter space, as opposed to anti-de Sitter.


title: Emergent phenomena from centre vortices in dynamical QCD

abstract: Quark confinement and dynamical chiral symmetry breaking are two of the most important emergent properties of the theory of quantum chromodynamics. We review recent results studying centre vortices in SU(3) lattice gauge theory with dynamical quarks. Through a vortex identification procedure, vortex-removed and vortex-only fields are obtained from the usual Monte Carlo generated gauge fields. Several comparisons between the untouched fields and the vortex-modified fields support the notion that centre vortices are fundamental to both confinement and dynamical chiral symmetry breaking in full QCD.


title: Learning PDE Solution Operator for Continuous Modeling of Time-Series

abstract: Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make specific assumptions on the type of DEs, making the model specialized for particular problems. This work presents a partial differential equation (PDE) based framework which improves the dynamics modeling capability. Building upon the recent Fourier neural operator, we propose a neural operator that can handle time continuously without requiring iterative operations or specific grids of temporal discretization. A theoretical result demonstrating its universality is provided. We also uncover an intrinsic property of neural operators that improves data efficiency and model generalization by ensuring stability. Our model achieves superior accuracy in dealing with time-dependent PDEs compared to existing models. Furthermore, several numerical pieces of evidence validate that our method better represents a wide range of dynamics and outperforms state-of-the-art DE-based models in real-time-series applications. Our framework opens up a new way for a continuous representation of neural networks that can be readily adopted for real-world applications.


title: Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling

abstract: Molecular dynamic simulations are important in computational physics, chemistry, material, and biology. Machine learning-based methods have shown strong abilities in predicting molecular energy and properties and are much faster than DFT calculations. Molecular energy is at least related to atoms, bonds, bond angles, torsion angles, and nonbonding atom pairs. Previous Transformer models only use atoms as inputs which lack explicit modeling of the aforementioned factors. To alleviate this limitation, we propose Moleformer, a novel Transformer architecture that takes nodes (atoms) and edges (bonds and nonbonding atom pairs) as inputs and models the interactions among them using rotational and translational invariant geometry-aware spatial encoding. Proposed spatial encoding calculates relative position information including distances and angles among nodes and edges. We benchmark Moleformer on OC20 and QM9 datasets, and our model achieves state-of-the-art on the initial state to relaxed energy prediction of OC20 and is very competitive in QM9 on predicting quantum chemical properties compared to other Transformer and Graph Neural Network (GNN) methods which proves the effectiveness of the proposed geometry-aware spatial encoding in Moleformer.


title: idT5: Indonesian Version of Multilingual T5 Transformer

abstract: Indonesian language is spoken by almost 200 million people and is the 10th most spoken language in the world, but it is under-represented in NLP (Natural Language Processing) research. A sparsity of language resources has hampered previous work on Indonesian. The Transformer is a new architecture rapidly becoming dominant for NLP, surpassing alternatives like convolutional and recurrent neural networks. T5 (Text-to-Text Transfer Transformer) is a Transformer model that converts all text-based language problems to text-to-text format for English. The multilingual variant is mT5 (multilingual T5) which has shown promising results on many NLP tasks across languages. However, the size of this multilingual model is a drawback for its application in real production applications, which sometimes require only one language. In this study, the mT5 model was adapted for only one language, Indonesian, resulting in a pre-trained T5 model that was specific only for Indonesian with a smaller size. For performance comparison, we fine-tuned this model and the mT5 model to the Sentiment Analysis (SA), Question Generation (QG), and Question Answering (QA) tasks with the exact mechanism and dataset. Fine-tuned model based on our model achieved 77.18% accuracy on SA, 8% higher than the mT5-based model, and obtained nearly the same score as the mT5-based model on QG and QA. The results confirm that it is possible to produce a smaller pre-trained model that maintains comparable yields while reducing the model size by up to 58%. In addition, the resulting model requires less memory, loads faster, and inference times faster.


title: Algorithm Design for Online Meta-Learning with Task Boundary Detection

abstract: Online meta-learning has recently emerged as a marriage between batch meta-learning and online learning, for achieving the capability of quick adaptation on new tasks in a lifelong manner. However, most existing approaches focus on the restrictive setting where the distribution of the online tasks remains fixed with known task boundaries. In this work, we relax these assumptions and propose a novel algorithm for task-agnostic online meta-learning in non-stationary environments. More specifically, we first propose two simple but effective detection mechanisms of task switches and distribution shift based on empirical observations, which serve as a key building block for more elegant online model updates in our algorithm: the task switch detection mechanism allows reusing of the best model available for the current task at hand, and the distribution shift detection mechanism differentiates the meta model update in order to preserve the knowledge for in-distribution tasks and quickly learn the new knowledge for out-of-distribution tasks. In particular, our online meta model updates are based only on the current data, which eliminates the need of storing previous data as required in most existing methods. We further show that a sublinear task-averaged regret can be achieved for our algorithm under mild conditions. Empirical studies on three different benchmarks clearly demonstrate the significant advantage of our algorithm over related baseline approaches.


abstract: The goal of continual learning is to provide intelligent agents that are capable of learning continually a sequence of tasks using the knowledge obtained from previous tasks while performing well on prior tasks. However, a key challenge in this continual learning paradigm is catastrophic forgetting, namely adapting a model to new tasks often leads to severe performance degradation on prior tasks. Current memory-based approaches show their success in alleviating the catastrophic forgetting problem by replaying examples from past tasks when new tasks are learned. However, these methods are infeasible to transfer the structural knowledge from previous tasks i.e., similarities or dissimilarities between different instances. Furthermore, the learning bias between the current and prior tasks is also an urgent problem that should be solved. In this work, we propose a new method, named Online Continual Learning via the Knowledge Invariant and Spread-out Properties (OCLKISP), in which we constrain the evolution of the embedding features via Knowledge Invariant and Spread-out Properties (KISP). Thus, we can further transfer the inter-instance structural knowledge of previous tasks while alleviating the forgetting due to the learning bias. We empirically evaluate our proposed method on four popular benchmarks for continual learning: Split CIFAR 100, Split SVHN, Split CUB200 and Split Tiny-Image-Net. The experimental results show the efficacy of our proposed method compared to the state-of-the-art continual learning algorithms.


title: Finite Orbits in Surfaces with a Double Elliptic Fibration and Torsion Values of Sections

abstract: We consider surfaces with a double elliptic fibration, with two sections. We study the orbits under the induced translation automorphisms proving that, under natural conditions, the finite orbits are confined to a curve. This goes in a similar direction of (and is motivated by) recent work by Cantat-Dujardin, although we use very different methods and obtain related but different results. As a sample of application of similar arguments, we prove a new case of the Zilber-Pink conjecture, namely Theorem 1.5, for certain schemes over a 2-dimensional base, which was known to lead to substantial difficulties. Most results rely, among other things, on recent theorems by Bakker and the second author of `Ax-Schanuel Type'; we also relate a functional condition with a theorem of Shioda on ramified sections of the Legendre scheme. For one of our proofs, we also use recent height inequalities by Yuan-Zhang. Finally, in an appendix, we show that the Relative Manin-Mumford Conjecture over the complex number field is equivalent to its version over the field of algebraic numbers.


title: Interventional and Counterfactual Inference with Diffusion Models

abstract: We consider the problem of answering observational, interventional, and counterfactual queries in a causally sufficient setting where only observational data and the causal graph are available. Utilizing the recent developments in diffusion models, we introduce diffusion-based causal models (DCM) to learn causal mechanisms, that generate unique latent encodings. These encodings enable us to directly sample under interventions and perform abduction for counterfactuals. Diffusion models are a natural fit here, since they can encode each node to a latent representation that acts as a proxy for exogenous noise. Our empirical evaluations demonstrate significant improvements over existing state-of-the-art methods for answering causal queries. Furthermore, we provide theoretical results that offer a methodology for analyzing counterfactual estimation in general encoder-decoder models, which could be useful in settings beyond our proposed approach.


title: SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling

abstract: Time series analysis is widely used in extensive areas. Recently, to reduce labeling expenses and benefit various tasks, self-supervised pre-training has attracted immense interest. One mainstream paradigm is masked modeling, which successfully pre-trains deep models by learning to reconstruct the masked content based on the unmasked part. However, since the semantic information of time series is mainly contained in temporal variations, the standard way of randomly masking a portion of time points will seriously ruin vital temporal variations of time series, making the reconstruction task too difficult to guide representation learning. We thus present SimMTM, a Simple pre-training framework for Masked Time-series Modeling. By relating masked modeling to manifold learning, SimMTM proposes to recover masked time points by the weighted aggregation of multiple neighbors outside the manifold, which eases the reconstruction task by assembling ruined but complementary temporal variations from multiple masked series. SimMTM further learns to uncover the local structure of the manifold, which is helpful for masked modeling. Experimentally, SimMTM achieves state-of-the-art fine-tuning performance compared to the most advanced time series pre-training methods in two canonical time series analysis tasks: forecasting and classification, covering both in- and cross-domain settings.


title: Hamiltonian formulation and symplectic split-operator schemes for time-dependent density-functional-theory equations of electron dynamics in molecules

abstract: We revisit Kohn-Sham time-dependent density-functional theory (TDDFT) equations and show that they derive from a canonical Hamiltonian formalism. We use this geometric description of the TDDFT dynamics to define families of symplectic split-operator schemes that accurately and efficiently simulate the time propagation for certain classes of DFT functionals. We illustrate these with numerical simulations of the far-from-equilibrium electronic dynamics of a one-dimensional carbon chain. In these examples, we find that an optimized 4th order scheme provides a good compromise between the numerical complexity of each time step and the accuracy of the scheme. We also discuss how the Hamiltonian structure changes when using a basis set to discretize TDDFT and the challenges this raises for using symplectic split-operator propagation schemes.


title: The Challenges and Opportunities in Creating an Early Warning System for Global Pandemics

abstract: The COVID-19 pandemic revealed that global health, social systems, and economies can be surprisingly fragile in an increasingly interconnected and interdependent world. Yet, during the last half of 2022, and quite remarkably, we began dismantling essential infectious disease monitoring programs in several countries. Absent such programs, localized biological risks will transform into global shocks linked directly to our lack of foresight regarding emerging health risks. Additionally, recent studies indicate that more than half of all infectious diseases could be made worse by climate change, complicating pandemic containment. Despite this complexity, the factors leading to pandemics are largely predictable but can only be realized through a well-designed global early warning system. Such a system should integrate data from genomics, climate and environment, social dynamics, and healthcare infrastructure. The glue for such a system is community-driven modeling, a modern logistics of data, and democratization of AI tools. Using the example of dengue fever in Brazil, we can demonstrate how thoughtfully designed technology platforms can build global-scale precision disease detection and response systems that significantly reduce exposure to systemic shocks, accelerate science-informed public health policies, and deliver reliable healthcare and economic opportunities as an intrinsic part of the global sustainable development agenda.


title: CLIPood: Generalizing CLIP to Out-of-Distributions

abstract: Out-of-distribution (OOD) generalization, where the model needs to handle distribution shifts from training, is a major challenge of machine learning. Contrastive language-image pre-training (CLIP) models have shown impressive zero-shot ability, but the further adaptation of CLIP on downstream tasks undesirably degrades OOD performances. This paper aims at generalizing CLIP to out-of-distribution test data on downstream tasks. We propose CLIPood, a fine-tuning method that can adapt CLIP models to OOD situations where both domain shifts and open classes may occur on the unseen test data. To exploit the semantic relations between classes from the text modality, CLIPood introduces a new training objective, margin metric softmax (MMS), with class adaptive margins for fine-tuning. To incorporate both pre-trained zero-shot model and fine-tuned task-adaptive model, CLIPood leverages a new optimization strategy, Beta moving average (BMA), to maintain a temporal ensemble weighted by Beta distribution. Experiments on diverse datasets with different OOD scenarios show that CLIPood consistently outperforms existing generalization techniques.


title: Enhanced repulsive Casimir forces between gold and thin magnetodielectric plates

abstract: We calculate repulsive Casimir forces between metallic and magnetic plates and quantitatively probe the magnetic plate's properties as tuning knobs for the repulsion. Namely, the plate's thickness and its low-frequency permittivity and permeability. For a thin magnetic plate ($\leq 10\,\text{nm}$), we find that repulsion can exist as long as $\mu(0) \geq \epsilon(0)$. We also explore the effect of temperature on the repulsion and transition distance between attractive and repulsive interactions. We show how the parameters can be tuned to allow repulsion at sub-micron separation regimes, making it potentially accessible to known high-resolution measurement techniques using magnetic van der Waals materials.


title: Exploring the Relationship Between Softness and Excess Entropy in Glass-forming Systems

abstract: We explore the relationship between a machine-learned structural quantity (softness) and excess entropy in simulations of supercooled liquids. Excess entropy is known to scale well the dynamical properties of liquids, but this quasi-universal scaling is known to breakdown in the supercooled and glassy regimes. Using numerical simulations, we test whether a local form of the excess entropy can lead to predictions that derive from softness, which has been shown to correlate well with the tendency for individual particles to rearrange. To that end, we explore leveraging softness to compute excess entropy in the traditional fashion over softness groupings. Our results show that by computing the excess entropy over softness-binned groupings, we can build a strong quantitative relationship between the rearrangement barriers across the explored systems.


title: Examining the validity of the minimal varying speed of light model through cosmological observations: relaxing the null curvature constraint

abstract: We revisit a consistency test for the speed of light variability, using the latest cosmological observations. This exercise can serve as a new diagnostics for the standard cosmological model and distinguish between the minimal varying speed of light in the Friedmann-Lema\^{i}tre-Robertson-Walker universe. We deploy Gaussian processes to reconstruct cosmic distances and ages in the redshift range $0<z<2$ utilizing the Pantheon compilation of type-Ia supernova luminosity distances (SN), cosmic chronometers from differential galaxy ages (CC), and measurements of both radial and transverse modes of baryon acoustic oscillations ($r$-BAO and $a$-BAO) respectively. Such a test has the advantage of being independent of any non-zero cosmic curvature assumption - which can be degenerated with some variable speed of light models - as well as any dark energy model. We also examine the impact of cosmological priors on our analysis, such as the Hubble constant, supernova absolute magnitude, and the sound horizon scale. We find null evidence for the speed of light variability hypothesis for most choices of priors and data-set combinations. However, mild deviations are seen at $\sim 2\sigma$ confidence level for redshifts $z<1$ with some specific prior choices when $r$-BAO data is employed, and at $z>1$ with a particular reconstruction kernel when $a$-BAO data are included. Still, we ascribe no statistical significance to this result bearing in mind the degeneracy between the associated priors for combined analysis, and incompleteness of the $a$-BAO data set at higher $z$.


title: Speech Enhancement for Virtual Meetings on Cellular Networks

abstract: We study speech enhancement using deep learning (DL) for virtual meetings on cellular devices, where transmitted speech has background noise and transmission loss that affects speech quality. Since the Deep Noise Suppression (DNS) Challenge dataset does not contain practical disturbance, we collect a transmitted DNS (t-DNS) dataset using Zoom Meetings over T-Mobile network. We select two baseline models: Demucs and FullSubNet. The Demucs is an end-to-end model that takes time-domain inputs and outputs time-domain denoised speech, and the FullSubNet takes time-frequency-domain inputs and outputs the energy ratio of the target speech in the inputs. The goal of this project is to enhance the speech transmitted over the cellular networks using deep learning models.


title: Disentanglement of Latent Representations via Causal Interventions

abstract: The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and independent component analysis fields. Recently, approaches merging these domains together have shown great success. Instead of directly representing the factors of variation, the problem of disentanglement can be seen as finding the interventions on one image that yield a change to a single factor. Following this assumption, we introduce a new method for disentanglement inspired by causal dynamics that combines causality theory with vector-quantized variational autoencoders. Our model considers the quantized vectors as causal variables and links them in a causal graph. It performs causal interventions on the graph and generates atomic transitions affecting a unique factor of variation in the image. We also introduce a new task of action retrieval that consists of finding the action responsible for the transition between two images. We test our method on standard synthetic and real-world disentanglement datasets. We show that it can effectively disentangle the factors of variation and perform precise interventions on high-level semantic attributes of an image without affecting its quality, even with imbalanced data distributions.


title: Extendable birational transformations belonging to Galois points

abstract: We study birational transformations belonging to Galois points. Let $P$ be a Galois point for a plane curve $C$ and $G_P$ be a Galois group at $P$. Then an element of $G_P$ induces a birational transformation of $C$. In general, it is difficult to determine when this birational transformations can be extended to a Cremona (or projective) transformation. In this article, we shall prove that if the Galois group is isomorphic to the cyclic group of order three, then any element of the Galois group has an expression as a de Jonqui\`{e}res transformation. In particular, they can be extended to Cremona transformations.


title: Using In-Context Learning to Improve Dialogue Safety

abstract: While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which often perpetuates social biases or stereotypes. We investigate a retrieval-based method for reducing bias and toxicity in responses from chatbots. It uses in-context learning to steer a model towards safer generations. Concretely, to generate a response to an unsafe dialogue context, we retrieve demonstrations of safe responses to similar dialogue contexts. We find our method performs competitively with strong baselines without requiring training. For instance, using automatic evaluation, we find our best fine-tuned baseline only generates safe responses to unsafe dialogue contexts from DiaSafety 4.04% more than our approach. Finally, we also propose a re-ranking procedure which can further improve response safeness.


title: Reliable Prediction Intervals with Directly Optimized Inductive Conformal Regression for Deep Learning

abstract: By generating prediction intervals (PIs) to quantify the uncertainty of each prediction in deep learning regression, the risk of wrong predictions can be effectively controlled. High-quality PIs need to be as narrow as possible, whilst covering a preset proportion of real labels. At present, many approaches to improve the quality of PIs can effectively reduce the width of PIs, but they do not ensure that enough real labels are captured. Inductive Conformal Predictor (ICP) is an algorithm that can generate effective PIs which is theoretically guaranteed to cover a preset proportion of data. However, typically ICP is not directly optimized to yield minimal PI width. However, in this study, we use Directly Optimized Inductive Conformal Regression (DOICR) that takes only the average width of PIs as the loss function and increases the quality of PIs through an optimized scheme under the validity condition that sufficient real labels are captured in the PIs. Benchmark experiments show that DOICR outperforms current state-of-the-art algorithms for regression problems using underlying Deep Neural Network structures for both tabular and image data.


title: Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network

abstract: Graphs consisting of vocal nodes ("the vocal minority") and silent nodes ("the silent majority"), namely VS-Graph, are ubiquitous in the real world. The vocal nodes tend to have abundant features and labels. In contrast, silent nodes only have incomplete features and rare labels, e.g., the description and political tendency of politicians (vocal) are abundant while not for ordinary people (silent) on the twitter's social network. Predicting the silent majority remains a crucial yet challenging problem. However, most existing message-passing based GNNs assume that all nodes belong to the same domain, without considering the missing features and distribution-shift between domains, leading to poor ability to deal with VS-Graph. To combat the above challenges, we propose Knowledge Transferable Graph Neural Network (KT-GNN), which models distribution shifts during message passing and representation learning by transferring knowledge from vocal nodes to silent nodes. Specifically, we design the domain-adapted "feature completion and message passing mechanism" for node representation learning while preserving domain difference. And a knowledge transferable classifier based on KL-divergence is followed. Comprehensive experiments on real-world scenarios (i.e., company financial risk assessment and political elections) demonstrate the superior performance of our method. Our source code has been open sourced.


title: Minimal homogeneous and noncrossing chain decompositions of posets

abstract: Homogeneous chain decompositions (HCDs) and noncrossing chain decompositions (NcCDs) of a poset are studied here, the former having a close connection to linear sequential dynamical systems while the latter generalizing the well-known noncrossing partitions. There exists a unique HCD containing the minimum number of chains for any poset and we show the number is not necessarily Lipschitz. Making use of the unique HCD, we then identify a group that contains an isomorphic copy of the automorphism group of the poset. Finally, we prove some upper bounds for the minimum number of chains contained in an NcCD. In particular, the number of chains in the unique HCD provides an upper bound.


title: Vision Transformer-based Feature Extraction for Generalized Zero-Shot Learning

abstract: Generalized zero-shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the image attribute. In this paper, we put forth a new GZSL approach exploiting Vision Transformer (ViT) to maximize the attribute-related information contained in the image feature. In ViT, the entire image region is processed without the degradation of the image resolution and the local image information is preserved in patch features. To fully enjoy these benefits of ViT, we exploit patch features as well as the CLS feature in extracting the attribute-related image feature. In particular, we propose a novel attention-based module, called attribute attention module (AAM), to aggregate the attribute-related information in patch features. In AAM, the correlation between each patch feature and the synthetic image attribute is used as the importance weight for each patch. From extensive experiments on benchmark datasets, we demonstrate that the proposed technique outperforms the state-of-the-art GZSL approaches by a large margin.


title: Improvement and Evaluation of Resilience of Adaptive Cruise Control Against Spoofing Attacks Using Intrusion Detection System

abstract: The Adaptive Cruise Control (ACC) system automatically adjusts the vehicle speed to maintain a safe distance between the vehicle and the lead (ahead) vehicle. The controller's decision to accelerate or decelerate is computed using the target speed of the vehicle and the difference between the vehicle's distance to the lead vehicle and the safe distance from that vehicle. Spoofing the vehicle speed communicated through the Controller Area Network (CAN) of the vehicle impacts negatively the capability of the ACC (Proportional-Integral-Derivative variant) to prevent crashes with the lead vehicle. The paper reports about extending the ACC with a real-time Intrusion Detection System (IDS) capable of detecting speed spoofing attacks with reasonable response time and detection rate, and simulating the proposed extension using the CARLA simulation platform. The results of the simulation are: (1) spoofing the vehicle speed can foil the ACC to falsely accelerate, causing accidents, and (2) extending ACC with ML-based IDS to trigger the brakes when an accident is imminent may mitigate the problem. The findings suggest exploring the capabilities of ML-based IDS to support the resilience mechanisms in mitigating cyber-attacks on vehicles.


title: Non-Hermitian Floquet-Free Analytically Solvable Time Dependant Systems

abstract: The non-Hermitian models, which are symmetric under parity (P) and time-reversal (T) operators, are the cornerstone for the fabrication of new ultra-sensitive optoelectronic devices. However, providing the gain in such systems usually demands precise contorol of nonlinear processes, limiting their application. In this paper, to bypass this obstacle, we introduce a class of time-dependent non-Hermitian Hamiltonians (not necessarily Floquet) that can describe a two-level system with temporally modulated on-site potential and couplings. We show that implementing an appropriate non-Unitary gauge transformation converts the original system to an effective one with a balanced gain and loss. This will allow us to derive the evolution of states analytically. Our proposed class of Hamiltonians can be employed in different platforms such as electronic circuits, acoustics, and photonics to design structures with hidden PT-symmetry potentially without imaginary onsite amplification and absorption mechanism to obtain an exceptional point.


title: The Contextual Lasso: Sparse Linear Models via Deep Neural Networks

abstract: Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible as functions of their input features than black-box models like deep neural networks. With this capability gap in mind, we study a not-uncommon situation where the input features dichotomize into two groups: explanatory features, which are candidates for inclusion as variables in an interpretable model, and contextual features, which select from the candidate variables and determine their effects. This dichotomy leads us to the contextual lasso, a new statistical estimator that fits a sparse linear model to the explanatory features such that the sparsity pattern and coefficients vary as a function of the contextual features. The fitting process learns this function nonparametrically via a deep neural network. To attain sparse coefficients, we train the network with a novel lasso regularizer in the form of a projection layer that maps the network's output onto the space of $\ell_1$-constrained linear models. An extensive suite of experiments on real and synthetic data suggests that the learned models, which remain highly transparent, can be sparser than the regular lasso without sacrificing the predictive power of a standard deep neural network.


title: Nuclear response to dark matter signals in Ge and Xe odd-mass targets

abstract: Abstract: The interaction of dark matter particles (WIMPs) with the odd-mass $^{73}$Ge and $^{131}$Xe target nuclei ,{ {that is the recoil rates corresponding to the elastic scattering of WIMPs by these nuclei}}, is analysed in the context of the minimal extensions of the SUSY model. The BCS+QRPA technique plus the quasiparticle-phonon coupling scheme is used to describe the nuclear structure part of the calculations. The resulting values for the nuclear spin content of both nuclei are compared to values previously reported in the literature.


title: Empirical Analysis of the AdaBoost's Error Bound

abstract: Understanding the accuracy limits of machine learning algorithms is essential for data scientists to properly measure performance so they can continually improve their models' predictive capabilities. This study empirically verified the error bound of the AdaBoost algorithm for both synthetic and real-world data. The results show that the error bound holds up in practice, demonstrating its efficiency and importance to a variety of applications. The corresponding source code is available at https://github.com/armanbolatov/adaboost_error_bound.


title: Can shallow quantum circuits scramble local noise into global white noise?

abstract: Shallow quantum circuits are believed to be the most promising candidates for achieving early practical quantum advantage - this has motivated the development of a broad range of error mitigation techniques whose performance generally improves when the quantum state is well approximated by a global depolarising (white) noise model. While it has been crucial for demonstrating quantum supremacy that random circuits scramble local noise into global white noise - a property that has been proved rigorously - we investigate to what degree practical shallow quantum circuits scramble local noise into global white noise. We define two key metrics as (a) density matrix eigenvalue uniformity and (b) commutator norm. While the former determines the distance from white noise, the latter determines the performance of purification based error mitigation. We derive analytical approximate bounds on their scaling and find in most cases they nicely match numerical results. On the other hand, we simulate a broad class of practical quantum circuits and find that white noise is in certain cases a bad approximation posing significant limitations on the performance of some of the simpler error mitigation schemes. On a positive note, we find in all cases that the commutator norm is sufficiently small guaranteeing a very good performance of purification-based error mitigation. Lastly, we identify techniques that may decrease both metrics, such as increasing the dimensionality of the dynamical Lie algebra by gate insertions or randomised compiling.


title: Ultrafast Hot-Carrier cooling in Quasi Freestanding Bilayer Graphene with Hydrogen Intercalated Atoms

abstract: We perform a femtosecond-THz optical pump-probe spectroscopy to investigate the cooling dynamics of hot carriers in quasi-free standing bilayer epitaxial graphene. We observed longer decay time constants, in the range of 2.6 to 6.4 ps, compared to previous studies on monolayer graphene, which increase nonlinearly with excitation intensity. The increased relaxation times are due to the decoupling of the graphene layer from the SiC substrate after hydrogen intercalation which increases the distance between graphene and substrate. Furthermore, our measurements do not show that the supercollision mechanism is related to the cooling process of the hot carriers, which is ultimately achieved by electron-optical phonon scattering.


title: Synthesizing Physical Character-Scene Interactions

abstract: Movement is how people interact with and affect their environment. For realistic character animation, it is necessary to synthesize such interactions between virtual characters and their surroundings. Despite recent progress in character animation using machine learning, most systems focus on controlling an agent's movements in fairly simple and homogeneous environments, with limited interactions with other objects. Furthermore, many previous approaches that synthesize human-scene interactions require significant manual labeling of the training data. In contrast, we present a system that uses adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Our method learns scene interaction behaviors from large unstructured motion datasets, without manual annotation of the motion data. These scene interactions are learned using an adversarial discriminator that evaluates the realism of a motion within the context of a scene. The key novelty involves conditioning both the discriminator and the policy networks on scene context. We demonstrate the effectiveness of our approach through three challenging scene interaction tasks: carrying, sitting, and lying down, which require coordination of a character's movements in relation to objects in the environment. Our policies learn to seamlessly transition between different behaviors like idling, walking, and sitting. By randomizing the properties of the objects and their placements during training, our method is able to generalize beyond the objects and scenarios depicted in the training dataset, producing natural character-scene interactions for a wide variety of object shapes and placements. The approach takes physics-based character motion generation a step closer to broad applicability.


title: Exploring Invariant Representation for Visible-Infrared Person Re-Identification

abstract: Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy. In this paper, we address the problem from both image-level and feature-level in an end-to-end hybrid learning framework named robust feature mining network (RFM). In particular, we observe that the reflective intensity of the same surface in photos shot in different wavelengths could be transformed using a linear model. Besides, we show the variable linear factor across the different surfaces is the main culprit which initiates the modality discrepancy. We integrate such a reflection observation into an image-level data augmentation by proposing the linear transformation generator (LTG). Moreover, at the feature level, we introduce a cross-center loss to explore a more compact intra-class distribution and modality-aware spatial attention to take advantage of textured regions more efficiently. Experiment results on two standard cross-spectral person re-identification datasets, i.e., RegDB and SYSU-MM01, have demonstrated state-of-the-art performance.


title: AOP-Net: All-in-One Perception Network for Joint LiDAR-based 3D Object Detection and Panoptic Segmentation

abstract: LiDAR-based 3D object detection and panoptic segmentation are two crucial tasks in the perception systems of autonomous vehicles and robots. In this paper, we propose All-in-One Perception Network (AOP-Net), a LiDAR-based multi-task framework that combines 3D object detection and panoptic segmentation. In this method, a dual-task 3D backbone is developed to extract both panoptic- and detection-level features from the input LiDAR point cloud. Also, a new 2D backbone that intertwines Multi-Layer Perceptron (MLP) and convolution layers is designed to further improve the detection task performance. Finally, a novel module is proposed to guide the detection head by recovering useful features discarded during down-sampling operations in the 3D backbone. This module leverages estimated instance segmentation masks to recover detailed information from each candidate object. The AOP-Net achieves state-of-the-art performance for published works on the nuScenes benchmark for both 3D object detection and panoptic segmentation tasks. Also, experiments show that our method easily adapts to and significantly improves the performance of any BEV-based 3D object detection method.


title: Read It, Don't Watch It: Captioning Bug Recordings Automatically

abstract: Screen recordings of mobile applications are easy to capture and include a wealth of information, making them a popular mechanism for users to inform developers of the problems encountered in the bug reports. However, watching the bug recordings and efficiently understanding the semantics of user actions can be time-consuming and tedious for developers. Inspired by the conception of the video subtitle in movie industry, we present a lightweight approach CAPdroid to caption bug recordings automatically. CAPdroid is a purely image-based and non-intrusive approach by using image processing and convolutional deep learning models to segment bug recordings, infer user action attributes, and generate subtitle descriptions. The automated experiments demonstrate the good performance of CAPdroid in inferring user actions from the recordings, and a user study confirms the usefulness of our generated step descriptions in assisting developers with bug replay.


title: Kainate receptor modulation by NETO2

abstract: Glutamate-gated kainate receptors (KARs) are ubiquitous in the central nervous system of vertebrates, mediate synaptic transmission on post-synapse, and modulate transmitter release on pre-synapse. In the brain, the trafficking, gating kinetics, and pharmacology of KARs are tightly regulated by Neuropilin and tolloid-like proteins (Netos). Here we report cryo-EM structures of homo-tetrameric GluK2 in complex with Neto2 at inhibited and desensitized states, illustrating variable stoichiometry of GluK2-Neto2 complexes, with one or two Neto2 subunits associate with the GluK2. We find that Neto2 accesses only two broad faces of KARs, intermolecularly crosslinking the lower-lobe of ATDA/C, upper-lobe of LBDB/D, and lower-lobe of LBDA/C, illustrating how Neto2 regulates receptor-gating kinetics. The transmembrane helix of Neto2 is positioned proximal to the selectivity filter and competes with the amphiphilic H1-helix after M4 for interacting with an ICD formed by the M1-M2 linkers of the receptor, revealing how rectification is regulated by Neto2.


title: Well-posedness and analyticity of solutions for the sixth-order Boussinesq equation

abstract: Studied in this paper is the sixth-order Boussinesq equation. We extend the local well-posedness theory for this equation with quadratic and cubic nonlinearities to the high dimensional case. In spite of having the ``bad'' fourth term $\Delta u$ in the equation, we derive some dispersive estimates leading to the existence of local solutions which also improves the previous results in the cubic case. In addition, we show persistence of spatial analyticity of solutions for the cubic nonlinearity.


title: On a Class of Non-Univalent functions Associated with a Parabolic Region

abstract: In the present investigation, we introduce and study the geometric properties of a class of analytic functions, associated with a parabolic region majorly lying in the left-half plane. Further we establish radius and majorization results for the class under study with pictorial illustrations of some of its special cases. Also we derive some sufficient conditions for the class under consideration.


title: Neural Common Neighbor with Completion for Link Prediction

abstract: In this work, we propose a novel link prediction model and further boost it by studying graph incompleteness. First, we introduce MPNN-then-SF, an innovative architecture leveraging structural feature (SF) to guide MPNN's representation pooling, with its implementation, namely Neural Common Neighbor (NCN). NCN exhibits superior expressiveness and scalability compared with existing models, which can be classified into two categories: SF-then-MPNN, augmenting MPNN's input with SF, and SF-and-MPNN, decoupling SF and MPNN. Second, we investigate the impact of graph incompleteness -- the phenomenon that some links are unobserved in the input graph -- on SF, like the common neighbor. Through dataset visualization, we observe that incompleteness reduces common neighbors and induces distribution shifts, significantly affecting model performance. To address this issue, we propose to use a link prediction model to complete the common neighbor structure. Combining this method with NCN, we propose Neural Common Neighbor with Completion (NCNC). NCN and NCNC outperform recent strong baselines by large margins, and NCNC further surpasses state-of-the-art models in standard link prediction benchmarks. Our code is available at https://github.com/GraphPKU/NeuralCommonNeighbor.


title: Role of Bootstrap Averaging in Generalized Approximate Message Passing

abstract: Generalized approximate message passing (GAMP) is a computationally efficient algorithm for estimating an unknown signal $w_0\in\mathbb{R}^N$ from a random linear measurement $y= Xw_0 + \epsilon\in\mathbb{R}^M$, where $X\in\mathbb{R}^{M\times N}$ is a known measurement matrix and $\epsilon$ is the noise vector. The salient feature of GAMP is that it can provide an unbiased estimator $\hat{r}^{\rm G}\sim\mathcal{N}(w_0, \hat{s}^2I_N)$, which can be used for various hypothesis-testing methods. In this study, we consider the bootstrap average of an unbiased estimator of GAMP for the elastic net. By numerically analyzing the state evolution of \emph{approximate message passing with resampling}, which has been proposed for computing bootstrap statistics of the elastic net estimator, we investigate when the bootstrap averaging reduces the variance of the unbiased estimator and the effect of optimizing the size of each bootstrap sample and hyperparameter of the elastic net regularization in the asymptotic setting $M, N\to\infty, M/N\to\alpha\in(0,\infty)$. The results indicate that bootstrap averaging effectively reduces the variance of the unbiased estimator when the actual data generation process is inconsistent with the sparsity assumption of the regularization and the sample size is small. Furthermore, we find that when $w_0$ is less sparse, and the data size is small, the system undergoes a phase transition. The phase transition indicates the existence of the region where the ensemble average of unbiased estimators of GAMP for the elastic net norm minimization problem yields the unbiased estimator with the minimum variance.

categories: cs.IT cond-mat.dis-nn math.IT math.ST stat.TH


title: Quantum Graph Learning: Frontiers and Outlook

abstract: Quantum theory has shown its superiority in enhancing machine learning. However, facilitating quantum theory to enhance graph learning is in its infancy. This survey investigates the current advances in quantum graph learning (QGL) from three perspectives, i.e., underlying theories, methods, and prospects. We first look at QGL and discuss the mutualism of quantum theory and graph learning, the specificity of graph-structured data, and the bottleneck of graph learning, respectively. A new taxonomy of QGL is presented, i.e., quantum computing on graphs, quantum graph representation, and quantum circuits for graph neural networks. Pitfall traps are then highlighted and explained. This survey aims to provide a brief but insightful introduction to this emerging field, along with a detailed discussion of frontiers and outlook yet to be investigated.


title: MetaTKG: Learning Evolutionary Meta-Knowledge for Temporal Knowledge Graph Reasoning

abstract: Reasoning over Temporal Knowledge Graphs (TKGs) aims to predict future facts based on given history. One of the key challenges for prediction is to learn the evolution of facts. Most existing works focus on exploring evolutionary information in history to obtain effective temporal embeddings for entities and relations, but they ignore the variation in evolution patterns of facts, which makes them struggle to adapt to future data with different evolution patterns. Moreover, new entities continue to emerge along with the evolution of facts over time. Since existing models highly rely on historical information to learn embeddings for entities, they perform poorly on such entities with little historical information. To tackle these issues, we propose a novel Temporal Meta-learning framework for TKG reasoning, MetaTKG for brevity. Specifically, our method regards TKG prediction as many temporal meta-tasks, and utilizes the designed Temporal Meta-learner to learn evolutionary meta-knowledge from these meta-tasks. The proposed method aims to guide the backbones to learn to adapt quickly to future data and deal with entities with little historical information by the learned meta-knowledge. Specially, in temporal meta-learner, we design a Gating Integration module to adaptively establish temporal correlations between meta-tasks. Extensive experiments on four widely-used datasets and three backbones demonstrate that our method can greatly improve the performance.


title: How to choose "Good" Samples for Text Data Augmentation

abstract: Deep learning-based text classification models need abundant labeled data to obtain competitive performance. Unfortunately, annotating large-size corpus is time-consuming and laborious. To tackle this, multiple researches try to use data augmentation to expand the corpus size. However, data augmentation may potentially produce some noisy augmented samples. There are currently no works exploring sample selection for augmented samples in nature language processing field. In this paper, we propose a novel self-training selection framework with two selectors to select the high-quality samples from data augmentation. Specifically, we firstly use an entropy-based strategy and the model prediction to select augmented samples. Considering some samples with high quality at the above step may be wrongly filtered, we propose to recall them from two perspectives of word overlap and semantic similarity. Experimental results show the effectiveness and simplicity of our framework.


title: Spin-driven stationary turbulence in spinor Bose-Einstein condensates

abstract: We report the observation of stationary turbulence in antiferromagnetic spin-1 Bose-Einstein condensates driven by a radio-frequency magnetic field. The magnetic driving injects energy into the system by spin rotation and the energy is dissipated via dynamic instability, resulting in the emergence of an irregular spin texture in the condensate. Under continuous driving, the spinor condensate evolves into a nonequilibrium steady state with characteristic spin turbulence, while the low energy scale of spin excitations ensures that the sample's lifetime is minimally affected. When the driving strength is on par with the system's spin interaction energy and the quadratic Zeeman energy, remarkably, the stationary turbulent state exhibits spin-isotropic features in spin composition and spatial spin texture. We numerically show that ambient field fluctuations play a crucial role in sustaining the turbulent state within the system. These results open up new avenues for exploring quantum turbulence in spinor superfluid systems.


title: Conditions implying the normality of $\ast$-paranormal operators in the closure of $\mathcal{AN}$-operators

abstract: In this article, we first prove the existence of an invariant subspace for a norm-attaining $\ast$-paranormal operator. Then give a representation for $\ast$-paranormal operators in the closure of absolutely norm-attaining operators and further study a few sufficient conditions for the normality of such operators. Finally, we discuss Toeplitz and Hankel $\ast$-paranormal operators in the closure of absolutely norm-attaining operators on the Hardy space.


title: Young stellar objects, accretion disks, and their variability with Rubin Observatory LSST

abstract: Vera C. Rubin Observatory, through the Legacy Survey of Space and Time (LSST), will allow us to derive a panchromatic view of variability in young stellar objects (YSOs) across all relevant timescales. Indeed, both short-term variability (on timescales of hours to days) and long-term variability (months to years), predominantly driven by the dynamics of accretion processes in disk-hosting YSOs, can be explored by taking advantage of the multi-band filters option available in Rubin LSST, in particular the $u,g,r,i$ filters that enable us to discriminate between photospheric stellar properties and accretion signatures. The homogeneity and depth of sky coverage that will be achieved with LSST will provide us with a unique opportunity to characterize the time evolution of disk accretion as a function of age and varying environmental conditions (e.g. field crowdedness, massive neighbors, metallicity), by targeting different star-forming regions. In this contribution to the Rubin LSST Survey Strategy Focus Issue, we discuss how implementing a dense observing cadence to explore short-term variability in YSOs represents a key complementary effort to the Wide-Fast-Deep observing mode that will be used to survey the sky over the full duration of the main survey ($\approx$10 years). The combination of these two modes will be vital to investigate the connection between the inner disk dynamics and longer-term eruptive variability behaviors, such as those observed on EXor objects.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.HE astro-ph.IM


title: Reduced basis approximation of parametric eigenvalue problems in presence of clusters and intersections

abstract: In this paper we discuss reduced order models for the approximation of parametric eigenvalue problems. In particular, we are interested in the presence of intersections or clusters of eigenvalues. The singularities originating by these phenomena make it hard a straightforward generalization of well known strategies normally used for standards PDEs. We investigate how the known results extend (or not) to higher order frequencies.


title: KST-Mixer: Kinematic Spatio-Temporal Data Mixer For Colon Shape Estimation

abstract: We propose a spatio-temporal mixing kinematic data estimation method to estimate the shape of the colon with deformations caused by colonoscope insertion. Endoscope tracking or a navigation system that navigates physicians to target positions is needed to reduce such complications as organ perforations. Although many previous methods focused to track bronchoscopes and surgical endoscopes, few number of colonoscope tracking methods were proposed. This is because the colon largely deforms during colonoscope insertion. The deformation causes significant tracking errors. Colon deformation should be taken into account in the tracking process. We propose a colon shape estimation method using a Kinematic Spatio-Temporal data Mixer (KST-Mixer) that can be used during colonoscope insertions to the colon. Kinematic data of a colonoscope and the colon, including positions and directions of their centerlines, are obtained using electromagnetic and depth sensors. The proposed method separates the data into sub-groups along the spatial and temporal axes. The KST-Mixer extracts kinematic features and mix them along the spatial and temporal axes multiple times. We evaluated colon shape estimation accuracies in phantom studies. The proposed method achieved 11.92 mm mean Euclidean distance error, the smallest of the previous methods. Statistical analysis indicated that the proposed method significantly reduced the error compared to the previous methods.


title: Connectedness of friends-and-strangers graphs of complete bipartite graphs and others

abstract: Let $X$ and $Y$ be any two graphs of order $n$. The friends-and-strangers graph $\mathsf{FS}(X,Y)$ of $X$ and $Y$ is a graph with vertex set consisting of all bijections $\sigma :V(X) \mapsto V(Y)$, in which two bijections $\sigma$, $\sigma'$ are adjacent if and only if they differ precisely on two adjacent vertices of $X$, and the corresponding mappings are adjacent in $Y$. The most fundamental question that one can ask about these friends-and-strangers graphs is whether or not they are connected. Let $K_{k,n-k}$ be a complete bipartite graph of order $n$. In 1974, Wilson characterized the connectedness of $\mathsf{FS}(K_{1,n-1},Y)$ by using algebraic methods. In this paper, by using combinatorial methods, we investigate the connectedness of $\mathsf{FS}(K_{k,n-k},Y)$ for any $Y$ and all $k\ge 2$, including $Y$ being a random graph, as suggested by Defant and Kravitz, and pose some open problems.


title: Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIs

abstract: Structural magnetic resonance imaging (sMRI) is widely used for brain neurological disease diagnosis; while longitudinal MRIs are often collected to monitor and capture disease progression, as clinically used in diagnosing Alzheimer's disease (AD). However, most current methods neglect AD's progressive nature and only take a single sMRI for recognizing AD. In this paper, we consider the problem of leveraging the longitudinal MRIs of a subject for AD identification. To capture longitudinal changes in sMRIs, we propose a novel model Longformer, a spatiotemporal transformer network that performs attention mechanisms spatially on sMRIs at each time point and integrates brain region features over time to obtain longitudinal embeddings for classification. Our Longformer achieves state-of-the-art performance on two binary classification tasks of separating different stages of AD using the ADNI dataset. Our source code is available at https://github.com/Qybc/LongFormer.


title: Language Quantized AutoEncoders: Towards Unsupervised Text-Image Alignment

abstract: Recent progress in scaling up large language models has shown impressive capabilities in performing few-shot learning across a wide range of text-based tasks. However, a key limitation is that these language models fundamentally lack visual perception - a crucial attribute needed to extend these models to be able to interact with the real world and solve vision tasks, such as in visual-question answering and robotics. Prior works have largely connected image to text through pretraining and/or fine-tuning on curated image-text datasets, which can be a costly and expensive process. In order to resolve this limitation, we propose a simple yet effective approach called Language-Quantized AutoEncoder (LQAE), a modification of VQ-VAE that learns to align text-image data in an unsupervised manner by leveraging pretrained language models (e.g., BERT, RoBERTa). Our main idea is to encode image as sequences of text tokens by directly quantizing image embeddings using a pretrained language codebook. We then apply random masking followed by a BERT model, and have the decoder reconstruct the original image from BERT predicted text token embeddings. By doing so, LQAE learns to represent similar images with similar clusters of text tokens, thereby aligning these two modalities without the use of aligned text-image pairs. This enables few-shot image classification with large language models (e.g., GPT-3) as well as linear classification of images based on BERT text features. To the best of our knowledge, our work is the first work that uses unaligned images for multimodal tasks by leveraging the power of pretrained language models.


title: No One Left Behind: Real-World Federated Class-Incremental Learning

abstract: Federated learning (FL) is a hot collaborative training framework via aggregating model parameters of decentralized local clients. However, most FL methods unreasonably assume data categories of FL framework are known and fixed in advance. Moreover, some new local clients that collect novel categories unseen by other clients may be introduced to FL training irregularly. These issues render global model to undergo catastrophic forgetting on old categories, when local clients receive new categories consecutively under limited memory of storing old categories. To tackle the above issues, we propose a novel Local-Global Anti-forgetting (LGA) model. It ensures no local clients are left behind as they learn new classes continually, by addressing local and global catastrophic forgetting. Specifically, considering tackling class imbalance of local client to surmount local forgetting, we develop a category-balanced gradient-adaptive compensation loss and a category gradient-induced semantic distillation loss. They can balance heterogeneous forgetting speeds of hard-to-forget and easy-to-forget old categories, while ensure consistent class-relations within different tasks. Moreover, a proxy server is designed to tackle global forgetting caused by Non-IID class imbalance between different clients. It augments perturbed prototype images of new categories collected from local clients via self-supervised prototype augmentation, thus improving robustness to choose the best old global model for local-side semantic distillation loss. Experiments on representative datasets verify superior performance of our model against comparison methods. The code is available at https://github.com/JiahuaDong/LGA.


title: Superclub, splitting, separating statements

abstract: We prove that superclub implies $\mathfrak{s}=\aleph_1$. More generally, superclub at a successor of a weakly compact cardinal implies $\mathfrak{s}_\kappa=\kappa^+$. Based on this statement, we separate tiltan from superclub at a successor of a supercompact cardinal. We use Galvin's property in order to separate tiltan from superclub at successors of both regular and singular cardinals.


title: 4D topology optimization: Integrated optimization of the structure and self-actuation of soft bodies for dynamic motions

abstract: Topology optimization is a powerful tool utilized in various fields for structural design. However, its application has primarily been restricted to static or passively moving objects, mainly focusing on hard materials with limited deformations and contact capabilities. Designing soft and actively moving objects, such as soft robots equipped with actuators, poses challenges due to simulating dynamics problems involving large deformations and intricate contact interactions. Moreover, the optimal structure depends on the object's motion, necessitating a simultaneous design approach. To address these challenges, we propose "4D topology optimization," an extension of density-based topology optimization that incorporates the time dimension. This enables the simultaneous optimization of both the structure and self-actuation of soft bodies for specific dynamic tasks. Our method utilizes multi-indexed and hierarchized density variables distributed over the spatiotemporal design domain, representing the material layout, actuator layout, and time-varying actuation. These variables are efficiently optimized using gradient-based methods. Forward and backward simulations of soft bodies are done using the material point method, a Lagrangian-Eulerian hybrid approach, implemented on a recent automatic differentiation framework. We present several numerical examples of self-actuating soft body designs aimed at achieving locomotion, posture control, and rotation tasks. The results demonstrate the effectiveness of our method in successfully designing soft bodies with complex structures and biomimetic movements, benefiting from its high degree of design freedom.


title: New Constructions of Optimal Binary LCD Codes

abstract: Linear complementary dual (LCD) codes can provide an optimum linear coding solution for the two-user binary adder channel. LCD codes also can be used to against side-channel attacks and fault non-invasive attacks. Let $d_{LCD}(n, k)$ denote the maximum value of $d$ for which a binary $[n,k, d]$ LCD code exists. In \cite{BS21}, Bouyuklieva conjectured that $d_{LCD}(n+1, k)=d_{LCD}(n, k)$ or $d_{LCD}(n, k) + 1$ for any lenth $n$ and dimension $k \ge 2$. In this paper, we first prove Bouyuklieva's conjecture \cite{BS21} by constructing a binary $[n,k,d-1]$ LCD codes from a binary $[n+1,k,d]$ $LCD_{o,e}$ code, when $d \ge 3$ and $k \ge 2$. Then we provide a distance lower bound for binary LCD codes by expanded codes, and use this bound and some methods such as puncturing, shortening, expanding and extension, we construct some new binary LCD codes. Finally, we improve some previously known values of $d_{LCD}(n, k)$ of lengths $38 \le n \le 40$ and dimensions $9 \le k \le 15$. We also obtain some values of $d_{LCD}(n, k)$ with $41 \le n \le 50$ and $6 \le k \le n-6$.


title: History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System

abstract: With the evolution of pre-trained language models, current open-domain dialogue systems have achieved great progress in conducting one-session conversations. In contrast, Multi-Session Conversation (MSC), which consists of multiple sessions over a long term with the same user, is under-investigated. In this paper, we propose History-Aware Hierarchical Transformer (HAHT) for multi-session open-domain dialogue. HAHT maintains a long-term memory of history conversations and utilizes history information to understand current conversation context and generate well-informed and context-relevant responses. Specifically, HAHT first encodes history conversation sessions hierarchically into a history memory. Then, HAHT leverages historical information to facilitate the understanding of the current conversation context by encoding the history memory together with the current context with attention-based mechanisms. Finally, to explicitly utilize historical information, HAHT uses a history-aware response generator that switches between a generic vocabulary and a history-aware vocabulary. Experimental results on a large-scale MSC dataset suggest that the proposed HAHT model consistently outperforms baseline models. Human evaluation results support that HAHT generates more human-like, context-relevant and history-relevant responses than baseline models.