title: Distributed Interval Observers for Bounded-Error LTI Systems

abstract: This paper proposes a novel distributed interval observer design for linear time-invariant (LTI) discrete-time systems subject to bounded disturbances. In the proposed observer algorithm, each agent in a networked group exchanges locally-computed framers or interval-valued state estimates with neighbors, and coordinates its update via an intersection operation. We show that the proposed framers are guaranteed to bound the true state trajectory of the system by construction, i.e., without imposing any additional assumptions or constraints. Moreover, we provide necessary and sufficient conditions for the collective stability of the distributed observer, i.e., to guarantee the uniform boundedness of the observer error sequence. In particular, we show that such conditions can be tractably satisfied through a constructive and distributed approach. Moreover, we provide an algorithm to verify some structural conditions for a given system, which guarantee the existence of the proposed observer. Finally, simulation results demonstrate the effectiveness of our proposed method compared to an existing distributed observer in the literature.


title: Application Of The ASME Boiler And Pressure Vessel Code In The Design Of SSR Cryomodule Beamlines For PIP-II Project At Fermilab

abstract: This contribution reports the design of the main components used to interconnect SRF cavities and superconducting focusing lenses in the SSR Cryomodule beamlines, developed in the framework of the PIP-II project at Fermilab. The focus of the present contribution is on the design and testing of the edge-welded bellows according to ASME Boiler and Pressure Vessel Code. The activities performed to qualify the bellows to be assembled in cleanroom, for operation in high vacuum, cryogenic environments, and their characterization from magnetic standpoint, will also be presented.


title: On the quasi-ergodicity of absorbing Markov chains with unbounded transition densities, including random logistic maps with escape

abstract: In this paper, we consider absorbing Markov chains $X_n$ admitting a quasi-stationary measure $\mu$ on $M$ where the transition kernel $\mathcal P$ admits an eigenfunction $0\leq \eta\in L^1(M,\mu)$. We find conditions on the transition densities of $\mathcal P$ with respect to $\mu$ which ensure that $\eta(x) \mu(\mathrm d x)$ is a quasi-ergodic measure for $X_n$ and that the Yaglom limit converges to the quasi-stationary measure $\mu$-almost surely. We apply this result to the random logistic map $X_{n+1} = \omega_n X_n (1-X_n)$ absorbed at $\mathbb R \setminus [0,1],$ where $\omega_n$ is an i.i.d sequence of random variables uniformly distributed in $[a,b],$ for $1\leq a <4$ and $b>4.$


title: Final Design Of The Pre-production SSR2 Cryomodule For PIP-II Project At Fermilab

abstract: The present contribution reports the design of the pre-production Single Spoke Resonator Type 2 Cryomodule (ppSSR2 CM), developed in the framework of the PIP-II project at Fermilab. The innovative design is based on a structure, the strongback, which supports the coldmass from the bottom, stays at room temperature during operations, and can slide longitudinally with respect to the vacuum vessel. The Fermilab style cryomodule developed for the prototype Single Spoke Resonator Type 1 (pSSR1) and the prototype High Beta 650 MHz (pHB650) cryomodules is the baseline of the current design, which paves the way for production SSR1 and SSR2 cryomodules for the PIP-II linac. The focus of this contribution is on the results of calculations and finite element analysis performed to optimize the critical components of the cryomodule: vacuum vessel, strongback, thermal shield, and magnetic shield.


title: Design, Manufacturing, Assembly, Testing, And Lessons Learned Of The Prototype 650 Mhz Couplers

abstract: Six 650 MHz high-power couplers will be integrated into the prototype High Beta 650 MHz (HB650) cryomodule for the PIP-II project at Fermilab. The design of the coupler is described, including design optimizations from the previous generation. This paper then describes the coupler life-cycle, including manufacturing, assembly, testing, conditioning, and the lessons learned at each stage.


title: Can One Hear the Spanning Trees of a Quantum Graph?

abstract: Kirchhoff showed that the number of spanning trees of a graph is the spectral determinant of the combinatorial Laplacian divided by the number of vertices; we reframe this result in the quantum graph setting. We prove that the spectral determinant of the Laplace operator on a finite connected metric graph with standard (Neummann-Kirchhoff) vertex conditions determines the number of spanning trees when the lengths of the edges of the metric graph are sufficiently close together. To obtain this result, we analyze an equilateral quantum graph whose spectrum is closely related to spectra of discrete graph operators and then use the continuity of the spectral determinant under perturbations of the edge lengths.


title: Security Best Practices: A Critical Analysis Using IoT as a Case Study

abstract: Academic research has highlighted the failure of many Internet of Things (IoT) product manufacturers to follow accepted practices, while IoT security best practices have recently attracted considerable attention worldwide from industry and governments. Given current examples of security advice, confusion is evident from guidelines that conflate desired outcomes with security practices to achieve those outcomes. We explore a surprising lack of clarity, and void in the literature, on what (generically) best practice means, independent of identifying specific individual practices or highlighting failure to follow best practices. We consider categories of security advice, and analyze how they apply over the lifecycle of IoT devices. For concreteness in discussion, we use iterative inductive coding to code and systematically analyze a set of 1013 IoT security best practices, recommendations, and guidelines collated from industrial, government, and academic sources. Among our findings, of all analyzed items, 68% fail to meet our definition of an (actionable) practice, and 73% of all actionable advice relates to the software development lifecycle phase, highlighting the critical position of manufacturers and developers. We hope that our work provides a basis for the community to better understand best practices, identify and reach consensus on specific practices, and find ways to motivate relevant stakeholders to follow them.


title: DPXPlain: Privately Explaining Aggregate Query Answers

abstract: Differential privacy (DP) is the state-of-the-art and rigorous notion of privacy for answering aggregate database queries while preserving the privacy of sensitive information in the data. In today's era of data analysis, however, it poses new challenges for users to understand the trends and anomalies observed in the query results: Is the unexpected answer due to the data itself, or is it due to the extra noise that must be added to preserve DP? In the second case, even the observation made by the users on query results may be wrong. In the first case, can we still mine interesting explanations from the sensitive data while protecting its privacy? To address these challenges, we present a three-phase framework DPXPlain, which is the first system to the best of our knowledge for explaining group-by aggregate query answers with DP. In its three phases, DPXPlain (a) answers a group-by aggregate query with DP, (b) allows users to compare aggregate values of two groups and with high probability assesses whether this comparison holds or is flipped by the DP noise, and (c) eventually provides an explanation table containing the approximately `top-k' explanation predicates along with their relative influences and ranks in the form of confidence intervals, while guaranteeing DP in all steps. We perform an extensive experimental analysis of DPXPlain with multiple use-cases on real and synthetic data showing that DPXPlain efficiently provides insightful explanations with good accuracy and utility.


title: Critical points of WAdS/CFT and higher-curvature gravity

abstract: WAdS/WCFT correspondence is an interesting realization of non-AdS holography. It relates 3-dimensional Warped-Anti-de Sitter (WAdS$_3$) spaces to a special class of 2-dimensional quantum field theory with chiral scaling symmetry that acts only on right-moving modes. The latter are often called Warped Conformal Field Theories (WCFT$_2$), and their existence makes WAdS/WCFT particularly interesting as a tool to investigate a new type of 2-dimensional conformal structure. Besides, WAdS/WCFT is interesting because it enables to apply holographic techniques to the microstate counting problem of non-AdS, non-supersymmetric black holes. Asymptotically WAdS$_3$ black holes (WBH$_3$) appear as solutions of topologically massive theories, Chern-Simons theories, and many other models. Here, we explore WBH$_3\times \Sigma_{D-3}$ solutions of $D$-dimensional higher-curvature gravity, with $\Sigma_{D-3}$ being different internal manifolds, typically given by products of deformations of hyperbolic spaces, although we also consider warped products with time-dependent deformations. These geometries are solutions of the second order higher-curvature theory at special (critical) points of the parameter space, where the theory exhibits a sort of degeneracy. We argue that the dual (W)CFT at those points is actually trivial. In many respects, these critical points of WAdS$_3 \times \Sigma_{D-3}$ vacua are the squashed/stretched analogs of the AdS$_D$ Chern-Simons point of Lovelock gravity.


title: Learning Practical Communication Strategies in Cooperative Multi-Agent Reinforcement Learning

abstract: In Multi-Agent Reinforcement Learning, communication is critical to encourage cooperation among agents. Communication in realistic wireless networks can be highly unreliable due to network conditions varying with agents' mobility, and stochasticity in the transmission process. We propose a framework to learn practical communication strategies by addressing three fundamental questions: (1) When: Agents learn the timing of communication based on not only message importance but also wireless channel conditions. (2) What: Agents augment message contents with wireless network measurements to better select the game and communication actions. (3) How: Agents use a novel neural message encoder to preserve all information from received messages, regardless of the number and order of messages. Simulating standard benchmarks under realistic wireless network settings, we show significant improvements in game performance, convergence speed and communication efficiency compared with state-of-the-art.


title: elhmc: An R Package for Hamiltonian Monte Carlo Sampling in Bayesian Empirical Likelihood

abstract: In this article, we describe a {\tt R} package for sampling from an empirical likelihood-based posterior using a Hamiltonian Monte Carlo method. Empirical likelihood-based methodologies have been used in Bayesian modeling of many problems of interest in recent times. This semiparametric procedure can easily combine the flexibility of a non-parametric distribution estimator together with the interpretability of a parametric model. The model is specified by estimating equations-based constraints. Drawing an inference from a Bayesian empirical likelihood (BayesEL) posterior is challenging. The likelihood is computed numerically, so no closed expression of the posterior exists. Moreover, for any sample of finite size, the support of the likelihood is non-convex, which hinders the fast mixing of many Markov Chain Monte Carlo (MCMC) procedures. It has been recently shown that using the properties of the gradient of log empirical likelihood, one can devise an efficient Hamiltonian Monte Carlo (HMC) algorithm to sample from a BayesEL posterior. The package requires the user to specify only the estimating equations, the prior, and their respective gradients. An MCMC sample drawn from the BayesEL posterior of the parameters, with various details required by the user is obtained.


title: Accelerating Polynomial Multiplication for Homomorphic Encryption on GPUs

abstract: Homomorphic Encryption (HE) enables users to securely outsource both the storage and computation of sensitive data to untrusted servers. Not only does HE offer an attractive solution for security in cloud systems, but lattice-based HE systems are also believed to be resistant to attacks by quantum computers. However, current HE implementations suffer from prohibitively high latency. For lattice-based HE to become viable for real-world systems, it is necessary for the key bottlenecks - particularly polynomial multiplication - to be highly efficient. In this paper, we present a characterization of GPU-based implementations of polynomial multiplication. We begin with a survey of modular reduction techniques and analyze several variants of the widely-used Barrett modular reduction algorithm. We then propose a modular reduction variant optimized for 64-bit integer words on the GPU, obtaining a 1.8x speedup over the existing comparable implementations. Next, we explore the following GPU-specific improvements for polynomial multiplication targeted at optimizing latency and throughput: 1) We present a 2D mixed-radix, multi-block implementation of NTT that results in a 1.85x average speedup over the previous state-of-the-art. 2) We explore shared memory optimizations aimed at reducing redundant memory accesses, further improving speedups by 1.2x. 3) Finally, we fuse the Hadamard product with neighboring stages of the NTT, reducing the twiddle factor memory footprint by 50%. By combining our NTT optimizations, we achieve an overall speedup of 123.13x and 2.37x over the previous state-of-the-art CPU and GPU implementations of NTT kernels, respectively.


title: Don't CWEAT It: Toward CWE Analysis Techniques in Early Stages of Hardware Design

abstract: To help prevent hardware security vulnerabilities from propagating to later design stages where fixes are costly, it is crucial to identify security concerns as early as possible, such as in RTL designs. In this work, we investigate the practical implications and feasibility of producing a set of security-specific scanners that operate on Verilog source files. The scanners indicate parts of code that might contain one of a set of MITRE's common weakness enumerations (CWEs). We explore the CWE database to characterize the scope and attributes of the CWEs and identify those that are amenable to static analysis. We prototype scanners and evaluate them on 11 open source designs - 4 system-on-chips (SoC) and 7 processor cores - and explore the nature of identified weaknesses. Our analysis reported 53 potential weaknesses in the OpenPiton SoC used in Hack@DAC-21, 11 of which we confirmed as security concerns.


title: Are Attribute Inference Attacks Just Imputation?

abstract: Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values of a sensitive feature of those records. We study a fine-grained variant of attribute inference we call \emph{sensitive value inference}, where the adversary's goal is to identify with high confidence some records from a candidate set where the unknown attribute has a particular sensitive value. We explicitly compare attribute inference with data imputation that captures the training distribution statistics, under various assumptions about the training data available to the adversary. Our main conclusions are: (1) previous attribute inference methods do not reveal more about the training data from the model than can be inferred by an adversary without access to the trained model, but with the same knowledge of the underlying distribution as needed to train the attribute inference attack; (2) black-box attribute inference attacks rarely learn anything that cannot be learned without the model; but (3) white-box attacks, which we introduce and evaluate in the paper, can reliably identify some records with the sensitive value attribute that would not be predicted without having access to the model. Furthermore, we show that proposed defenses such as differentially private training and removing vulnerable records from training do not mitigate this privacy risk. The code for our experiments is available at \url{https://github.com/bargavj/EvaluatingDPML}.


title: Single-Molecule Structure and Topology of Kinetoplast DNA Networks

abstract: The Kinetoplast DNA (kDNA) is a two-dimensional Olympic-ring-like network of mutually linked 2.5 kb-long DNA minicircles found in certain parasites called Trypanosomes. Understanding the self-assembly and replication of this structure are not only major open questions in biology but can also inform the design of synthetic topological materials. Here we report the first high-resolution, single-molecule study of kDNA network topology using AFM and steered molecular dynamics simulations. We map out the DNA density within the network and the distribution of linking number and valence of the minicircles. We also characterise the DNA hubs that surround the network and show that they cause a buckling transition akin to that of a 2D elastic thermal sheet in the bulk. Intriguingly, we observe a broad distribution of density and valence of the minicircles, indicating heterogeneous network structure and individualism of different kDNA structures. Our findings explain outstanding questions in the field and offer single-molecule insights into the properties of a unique topological material.


title: The effect of the interlayer ordering on the Fermi surface of Kagome superconductor CsV$_3$Sb$_5$ revealed by quantum oscillations

abstract: The connection between unconventional superconductivity and charge density waves (CDW) has intrigued the condensed matter community and found much interest in the recently discovered superconducting Kagome family of AV$_3$Sb$_5$ (A = K, Cs, Rb). Xray diffraction and Raman spectroscopy measurements established that the CDW order in CsV$_3$Sb$_5$ comprises of a 2x2x4 structure with stacking of layers of star-of-David (SD) and inverse-star-of-David (ISD) pattern along the $c$-axis direction. Such interlayer ordering will induce a vast normalization of the electronic ground state; however, it has not been observed in Fermi surface measurements. Here we report quantum oscillations of CsV$_3$Sb$_5$ using tunnel diode oscillator frequency measurements. We observed a large number of frequencies, many of which were not reported. The number of frequencies can not be explained by DFT calculations when only SD or ISD distortion is considered. Instead, our results are consistent with calculations when interlayer ordering is taken into account, providing strong evidence that CDW phase of CsV$_3$Sb$_5$ has complicated structure distortion which in turn has dramatic effects on the Fermi surface properties.


title: Optimal convergence for the regularized solution of the model describing the competition between super- and sub- diffusions driven by fractional Brownian sheet noise

abstract: Super- and sub- diffusions are two typical types of anomalous diffusions in the natural world. In this work, we discuss the numerical scheme for the model describing the competition between super- and sub- diffusions driven by fractional Brownian sheet noise. Based on the obtained regulization result of the solution by using the properties of Mittag-Leffler function and the regularized noise by Wong-Zakai approximation, we make full use of the regularity of the solution operators to achieve optimal convergence of the regularized solution. The spectral Galerkin method and the Mittag-Leffler Euler integrator are respectively used to deal with the space and time operators. In particular, by contour integral, the fast evaluation of the Mittag-Leffler Euler integrator is realized. We provide complete error analyses, which are verified by the numerical experiments.


title: Automatic model-based telluric correction for the ESPRESSO data reduction software. Model description and application to radial velocity computation

abstract: Ground-based high-resolution spectrographs are key instruments for several astrophysical domains. Unfortunately, the observed spectra are contaminated by the Earth's atmosphere. While different techniques exist to correct for telluric lines in exoplanet atmospheric studies, in radial velocity (RV) studies, telluric lines with an absorption depth of >2% are generally masked, which poses a problem for faint targets and M dwarfs as most of their RV content is present where telluric contamination is important. We propose a simple telluric model to be embedded in the ESPRESSO DRS. The goal is to provide telluric-free spectra and enable RV measurements, including spectral ranges where telluric lines fall. The model is a line-by-line radiative transfer code that assumes a single atmospheric layer. We use the sky conditions and the physical properties of the lines from HITRAN to create the telluric spectrum. A subset of selected telluric lines is used to robustly fit the spectrum through a Levenberg-Marquardt minimization algorithm. When applied to stellar spectra from A0- to M5-type stars, the residuals of the strongest H2O lines are below 2% for all spectral types, with the exception of M dwarfs, which are within the pseudo-continuum. We then determined the RVs from the telluric-corrected ESPRESSO spectra of Tau Ceti and Proxima. We created telluric-free masks and compared the obtained RVs with the DRS RVs. In the case of Tau Ceti, we identified that micro-telluric lines introduce systematics up to an amplitude of 58 cm/s and with a period of one year. For Proxima, the gain in spectral content at redder wavelengths is equivalent to a gain of 25% in photon noise. This leads to better constraints on the semi-amplitude and eccentricity of Proxima d. We showcase that our model can be applied to other molecules, and thus to other wavelength regions observed by other spectrographs, such as NIRPS.


title: Assessing treatment effect heterogeneity in the presence of missing effect modifier data in cluster-randomized trials

abstract: Understanding whether and how treatment effects vary across subgroups is crucial to inform clinical practice and recommendations. Accordingly, the assessment of heterogeneous treatment effects (HTE) based on pre-specified potential effect modifiers has become a common goal in modern randomized trials. However, when one or more potential effect modifiers are missing, complete-case analysis may lead to bias and under-coverage. While statistical methods for handling missing data have been proposed and compared for individually randomized trials with missing effect modifier data, few guidelines exist for the cluster-randomized setting, where intracluster correlations in the effect modifiers, outcomes, or even missingness mechanisms may introduce further threats to accurate assessment of HTE. In this article, the performance of several missing data methods are compared through a simulation study of cluster-randomized trials with continuous outcome and missing binary effect modifier data, and further illustrated using real data from the Work, Family, and Health Study. Our results suggest that multilevel multiple imputation (MMI) and Bayesian MMI have better performance than other available methods, and that Bayesian MMI has lower bias and closer to nominal coverage than standard MMI when there are model specification or compatibility issues.


title: Steady off-diagonal long-range order state in a half-filled dimerized Hubbard chain induced by a resonant pulsed field

abstract: We show that a resonant pulsed field can induce a steady superconducting state even in the deep Mott insulating phase of the dimerized Hubbard model. The superconductivity found here in the non-equilibrium steady state is due to the $\eta $-pairing mechanism, characterized by the existence of the off-diagonal long-range order (ODLRO), and is absent in the ground-state phase diagram. The key of the scheme lies in the generation of the field-induced charge density wave (CDW) state that is from the valence bond solid. The dynamics of this state resides in the highly-excited subspace of dimerized Hubbard model and is dominated by a $\eta $-spin ferromagnetic model. The decay of such long-living excitation is suppressed because of energy conservation. We also develop a dynamical method to detect the ODLRO of the non-equilibrium steady state. Our finding demonstrates that the non-equilibrium many-body dynamics induced by the interplay between the resonant external field and electron-electron interaction is an alternative pathway to access a new exotic quantum state, and also provides an alternative mechanism for enhancing superconductivity.


title: Insulating-to-conducting state transition in the bilayer Hubbard model induced by a perpendicular quench field

abstract: A many-body quantum system with varying parameters can exhibit two distinct quantum states within the same energy shell. This allows for a dynamic transition from the ground state of the pre-quench Hamiltonian to a steady state of the post-quench Hamiltonian. We investigate the dynamic response of the ground states in a two-layer half-filled Hubbard model to a perpendicular electric field. We demonstrate that the steady state exhibits conductivity when the field is in resonance with the on-site repulsion, while the initial state is a Mott-insulating state. Additionally, the two layers exhibit identical conducting behavior due to the formation of long-lived dopings, as evidenced by the charge fluctuation. The key factor in achieving this dynamic transition is the cooperative interplay between on-site interactions and the resonant field, rather than the individual roles they play. Our findings offer an alternative mechanism for field-induced conductivity in strongly correlated systems.


title: Source-Free Unsupervised Domain Adaptation with Norm and Shape Constraints for Medical Image Segmentation

abstract: Unsupervised domain adaptation (UDA) is one of the key technologies to solve a problem where it is hard to obtain ground truth labels needed for supervised learning. In general, UDA assumes that all samples from source and target domains are available during the training process. However, this is not a realistic assumption under applications where data privacy issues are concerned. To overcome this limitation, UDA without source data, referred to source-free unsupervised domain adaptation (SFUDA) has been recently proposed. Here, we propose a SFUDA method for medical image segmentation. In addition to the entropy minimization method, which is commonly used in UDA, we introduce a loss function for avoiding feature norms in the target domain small and a prior to preserve shape constraints of the target organ. We conduct experiments using datasets including multiple types of source-target domain combinations in order to show the versatility and robustness of our method. We confirm that our method outperforms the state-of-the-art in all datasets.


title: Geometry of EM and related iterative algorithms

abstract: The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of observables and unobservables. Its general properties are well studied, and also, there are countless ways to apply it to individual problems. In this paper, we introduce the $em$ algorithm, an information geometric formulation of the EM algorithm, and its extensions and applications to various problems. Specifically, we will see that it is possible to formulate an outlier-robust inference algorithm, an algorithm for calculating channel capacity, parameter estimation methods on probability simplex, particular multivariate analysis methods such as principal component analysis in a space of probability models and modal regression, matrix factorization, and learning generative models, which have recently attracted attention in deep learning, from the geometric perspective.


title: Observation of Spectral Structures in the Flux of Cosmic-Ray Protons from 50 GeV to 60 TeV with the Calorimetric Electron Telescope on the International Space Station

abstract: A precise measurement of the cosmic-ray proton spectrum with the Calorimetric Electron Telescope (CALET) is presented in the energy interval from 50 GeV to 60 TeV, and the observation of a softening of the spectrum above 10 TeV is reported. The analysis is based on the data collected during $\sim$6.2 years of smooth operations aboard the International Space Station and covers a broader energy range with respect to the previous proton flux measurement by CALET, with an increase of the available statistics by a factor of $\sim$2.2. Above a few hundred GeV we confirm our previous observation of a progressive spectral hardening with a higher significance (more than 20 sigma). In the multi-TeV region we observe a second spectral feature with a softening around 10 TeV and a spectral index change from =2.6 to -2.9 consistently, within the errors, with the shape of the spectrum reported by DAMPE. We apply a simultaneous fit of the proton differential spectrum which well reproduces the gradual change of the spectral index encompassing the lower energy power-law regime and the two spectral features observed at higher energies.


title: Acyclic Orientations and the Chromatic Polynomial of Signed Graphs

abstract: We present a new correspondence between acyclic orientations and coloring of a signed graph (symmetric graph). Goodall et al. introduced a bivariate chromatic polynomial $\chi_G(k,l)$ that counts the number of signed colorings using colors $0,\pm1,\dots,\pm k$ along with $l-1$ symmetric colors $0_1,\dots,0_{l-1}$. We show that the evaluation of the bivariate chromatic polynomial $|\chi_G(-1,2)|$ is equal to the number of acyclic orientations of the signed graph modulo the equivalence relation generated by swapping sources and sinks. We present three proofs of this fact, a proof using toric hyperplane arrangements, a proof using deletion-contraction, and a direct proof.


title: vieCap4H-VLSP 2021: Vietnamese Image Captioning for Healthcare Domain using Swin Transformer and Attention-based LSTM

abstract: This study presents our approach on the automatic Vietnamese image captioning for healthcare domain in text processing tasks of Vietnamese Language and Speech Processing (VLSP) Challenge 2021, as shown in Figure 1. In recent years, image captioning often employs a convolutional neural network-based architecture as an encoder and a long short-term memory (LSTM) as a decoder to generate sentences. These models perform remarkably well in different datasets. Our proposed model also has an encoder and a decoder, but we instead use a Swin Transformer in the encoder, and a LSTM combined with an attention module in the decoder. The study presents our training experiments and techniques used during the competition. Our model achieves a BLEU4 score of 0.293 on the vietCap4H dataset, and the score is ranked the 3$^{rd}$ place on the private leaderboard. Our code can be found at \url{https://git.io/JDdJm}.


title: Boosting the 21 cm forest signals by the clumpy substructures

abstract: We study the contribution of subhalos to the 21 cm forest signal. The halos can host the substructures and including the effects of those small scale clumps can potentially boost the 21 cm optical depth in favor of detecting the 21 cm forest signals. We estimate the boost factor representing the ratio of the optical depth due to the subhalo contribution and that due to the host halo alone (without subhalos). Even though the optical depth boost factor is negligible for a small host halo with the mass of order $10^5 M_{\odot}$, the subhalo contribution can enhance the optical depth by an order of magnitude for a host halo of order $10^7 M_{\odot}$. The resultant 21 cm absorption line abundance which is obtained by integrating over the halo mass range relevant for the 21 cm forest signal can be enhanced by up to of order $10\%$ due to the substructures. The larger boost factor for a larger host halo would be of particular interest for the 21 cm forest detection because the the contribution of the larger host halos to the 21 cm forest signals is smaller due to their higher temperature and less abundance than the smaller host halos. The subhalos hence can well help the larger host halos more important for the signal estimation which, without considering the subhalos, may not give appreciable contribution to 21 cm forest signals.


title: Euclidean traveller in hyperbolic worlds

abstract: We will discuss all possible closures of a Euclidean line in various geometric spaces. Imagine the Euclidean traveller, who travels only along a Euclidean line. She will be travelling to many different geometric worlds, and our question will be "what places does she get to see in each world?". Here is the itinerary of our Euclidean traveller: In 1884, she travels to the torus of any dimension, guided by Kronecker. In 1936, she travels to the world, called a closed hyperbolic surface, guided by Hedlund. In 1991, she then travels to a closed hyperbolic manifold of higher dimension $n\ge 3$ guided by Ratner. Finally, she adventures into hyperbolic manifolds of infinite volume guided by Dal'bo in dimension $2$ in 2000, by McMullen-Mohammadi-Oh in dimension $3$ in 2016 and by Lee-Oh in all higher dimensions in 2019.


title: TransPolymer: a Transformer-based language model for polymer property predictions

abstract: Accurate and efficient prediction of polymer properties is of great significance in polymer design. Conventionally, expensive and time-consuming experiments or simulations are required to evaluate polymer functions. Recently, Transformer models, equipped with self-attention mechanisms, have exhibited superior performance in natural language processing. However, such methods have not been investigated in polymer sciences. Herein, we report TransPolymer, a Transformer-based language model for polymer property prediction. Our proposed polymer tokenizer with chemical awareness enables learning representations from polymer sequences. Rigorous experiments on ten polymer property prediction benchmarks demonstrate the superior performance of TransPolymer. Moreover, we show that TransPolymer benefits from pretraining on large unlabeled dataset via Masked Language Modeling. Experimental results further manifest the important role of self-attention in modeling polymer sequences. We highlight this model as a promising computational tool for promoting rational polymer design and understanding structure-property relationships from a data science view.


title: Multimodal and Crossmodal AI for Smart Data Analysis

abstract: Recently, the multimodal and crossmodal AI techniques have attracted the attention of communities. The former aims to collect disjointed and heterogeneous data to compensate for complementary information to enhance robust prediction. The latter targets to utilize one modality to predict another modality by discovering the common attention sharing between them. Although both approaches share the same target: generate smart data from collected raw data, the former demands more modalities while the latter aims to decrease the variety of modalities. This paper first discusses the role of multimodal and crossmodal AI in smart data analysis in general. Then, we introduce the multimodal and crossmodal AI framework (MMCRAI) to balance the abovementioned approaches and make it easy to scale into different domains. This framework is integrated into xDataPF (the cross-data platform https://www.xdata.nict.jp/). We also introduce and discuss various applications built on this framework and xDataPF.


title: Oscillation inequalities in ergodic theory and analysis: one-parameter and multi-parameter perspectives

abstract: In this survey we review useful tools that naturally arise in the study of pointwise convergence problems in analysis, ergodic theory and probability. We will pay special attention to quantitative aspects of pointwise convergence phenomena from the point of view of oscillation estimates in both the single and several parameter settings. We establish a number of new oscillation inequalities and give new proofs for known results with elementary arguments.


title: Subtracting Compact Binary Foregrounds to Search for Subdominant Gravitational-Wave Backgrounds in Next-Generation Ground-Based Observatories

abstract: Stochastic gravitational-wave backgrounds (SGWBs) derive from the superposition of numerous individually unresolved gravitational-wave (GW) signals. Detecting SGWBs provides us with invaluable information about astrophysics, cosmology, and fundamental physics. In this paper, we study SGWBs from binary black-hole (BBH) and binary neutron-star (BNS) coalescences in a network of next-generation ground-based GW observatories (Cosmic Explorer and Einstein Telescope) and determine how well they can be measured; this then limits how well we can observe other subdominant astrophysical and cosmological SGWBs. We simulate all-Universe populations of BBHs and BNSs and calculate the corresponding SGWBs, which consist of a superposition of (i) undetected signals, and (ii) the residual background from imperfect removal of resolved sources. The sum of the two components sets the sensitivity for observing other SGWBs. Our results show that, even with next-generation observatories, the residual background is large and limits the sensitivity to other SGWBs. The main contributions to the residual background arise from uncertainties in inferring the coalescence phase and luminosity distance of the detected signals. Alternative approaches to signal subtraction would need to be explored to minimize the BBH and BNS foreground in order to observe SGWBs from other subdominant astrophysical and cosmological sources.


title: A Novel Self-Knowledge Distillation Approach with Siamese Representation Learning for Action Recognition

abstract: Knowledge distillation is an effective transfer of knowledge from a heavy network (teacher) to a small network (student) to boost students' performance. Self-knowledge distillation, the special case of knowledge distillation, has been proposed to remove the large teacher network training process while preserving the student's performance. This paper introduces a novel Self-knowledge distillation approach via Siamese representation learning, which minimizes the difference between two representation vectors of the two different views from a given sample. Our proposed method, SKD-SRL, utilizes both soft label distillation and the similarity of representation vectors. Therefore, SKD-SRL can generate more consistent predictions and representations in various views of the same data point. Our benchmark has been evaluated on various standard datasets. The experimental results have shown that SKD-SRL significantly improves the accuracy compared to existing supervised learning and knowledge distillation methods regardless of the networks.


title: An improved lower bound for the planar Tur\'an number of cycles

abstract: The planar Tur\'an number of a graph $H$, denoted by $ex_{_\mathcal{P}}(n,H)$, is the largest number of edges in a planar graph on $n $ vertices without containing $H$ as a subgraph. In this paper, we continue to study the topic of "extremal" planar graphs initiated by Dowden [J. Graph Theory 83 (2016) 213--230]. We first obtain an improved lower bound for $ex_{_\mathcal{P}}(n,C_k)$ for all $k\ge 13$ and $n\ge 5(k-6+\lfloor{(k-1)}/2\rfloor)(k-1)/2$; the construction for each $k$ and $n$ provides a simpler counterexample to a conjecture of Ghosh, Gy\H{o}ri, Martin, Paulos and Xiao [arxiv:2004.14094v1], which has recently been disproved by Cranston, Lidick\'y, Liu and Shantanam [Electron. J. Combin. 29(3) (2022) \#P3.31] for every $k\ge 11$ and $n$ sufficiently large (as a function of $k$). We then prove that $ex_{_\mathcal{P}}(n,H^+)=ex_{_\mathcal{P}}(n,H)$ for all $k\ge 5$ and $n\ge |H|+1$, where $H\in\{C_k, 2C_k\}$ and $H^+$ is obtained from $H$ by adding a pendant edge to a vertex of degree two.


title: Morphokinematic modelling of the point-symmetric Cat's Eye, NGC 6543: Ring-like remnants of a precessing jet

abstract: The planetary nebula known as the Cat's Eye Nebula (NGC 6543) has a complex, point-symmetric morphology that cannot be fully explained by the current theory of planetary nebula formation, the Interacting Stellar Winds Model. In order to reveal the three dimensional (3D) structure of the Cat's Eye Nebula, we created a detailed 3D morpho-kinematic model of this nebula using a [NII] image from the Hubble Space Telescope and five different position-velocity diagrams using the SHAPE code. This modeling approach has revealed point-symmetric partial rings, which were likely formed by a precessing jet.


title: Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labels

abstract: Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image classification due to the difficulty in defining the positive and negative instances to contrast a given anchor image in multi-label scenario, let the label missing one alone, implying that borrowing a commonly-used way from contrastive multi-class learning to define them will incur a lot of false negative instances unfavorable for learning. In this paper, with the introduction of a label correction mechanism to identify missing labels, we first elegantly generate positives and negatives for individual semantic labels of an anchor image, then define a unique contrastive loss for multi-label image classification with missing labels (CLML), the loss is able to accurately bring images close to their true positive images and false negative images, far away from their true negative images. Different from existing multi-label CL losses, CLML also preserves low-rank global and local label dependencies in the latent representation space where such dependencies have been shown to be helpful in dealing with missing labels. To the best of our knowledge, this is the first general multi-label CL loss in the missing-label scenario and thus can seamlessly be paired with those losses of any existing multi-label learning methods just via a single hyperparameter. The proposed strategy has been shown to improve the classification performance of the Resnet101 model by margins of 1.2%, 1.6%, and 1.3% respectively on three standard datasets, MSCOCO, VOC, and NUS-WIDE. Code is available at https://github.com/chuangua/ContrastiveLossMLML.


title: The Folded Pneumatic Artificial Muscle (foldPAM): Towards Programmability and Control via End Geometry

abstract: Soft pneumatic actuators have seen applications in many soft robotic systems, and their pressure-driven nature presents unique challenges and opportunities for controlling their motion. In this work, we present a new concept: designing and controlling pneumatic actuators via end geometry. We demonstrate a novel actuator class, named the folded Pneumatic Artificial Muscle (foldPAM), which features a thin-filmed air pouch that is symmetrically folded on each side. Varying the folded portion of the actuator changes the end constraints and, hence, the force-strain relationships. We investigated this change experimentally by measuring the force-strain relationship of individual foldPAM units with various lengths and amounts of folding. In addition to static-geometry units, an actuated foldPAM device was designed to produce continuous, on-demand adjustment of the end geometry, enabling closed-loop position control while maintaining constant pressure. Experiments with the device indicate that geometry control allows access to different areas on the force-strain plane and that closed-loop geometry control can achieve errors within 0.5% of the actuation range.


title: Soft breaking of the $\mu\leftrightarrow \tau$ symmetry by $\mathbf{S}_{4}\otimes \mathbf{Z}_{2}$

abstract: The $\mu \leftrightarrow \tau$ symmetry has been ruled out by its predictions on the reactor and atmospheric angles, nevertheless, a breaking of this symmetry might provide correct values. For that reason, we build a non-renormalizable lepton model where the mixings arise from the spontaneous breaking of the $\mathbf{S}_{4}\otimes \mathbf{Z}_{2}$ discrete group, subsequently the $\mu \leftrightarrow \tau$ symmetry is broken in the effective neutrino mass matrix, that comes from the type II see-saw mechanism. As main result, the reactor and atmospheric angles are corrected and their values are in good agreement with the experimental data for the inverted hierarchy. Furthermore, we point out a link between the atmospheric angle and reactor one. In the quark sector, under certain assumptions, the generalized Fritzsch textures shape to the quark mass matrices so that the CKM matrix values are guaranteed.


title: Illegal But Not Malware: An Underground Economy App Detection System Based on Usage Scenario

abstract: This paper focuses on mobile apps serving the underground economy by providing illegal services in the mobile system (e.g., gambling, porn, scam). These apps are named as underground economy apps, or UEware for short. As most UEware do not have malicious payloads, traditional malware detection approaches are ineffective to perform the detection. To address this problem, we propose a novel approach to effectively and efficiently detect UEware by considering the transition orders of the user interfaces (UIs), which determine the usage scenarios of these apps. Based on the proposed approach, we design a system named DeUEDroid to detect the UEware via scene graph. To evaluate DeUEDroid, we collect 26, 591 apps to evaluate DeUEDroid and build up the first large-scale ground-truth UEware dataset (1, 720 underground economy apps and 831 legitimate apps). The evaluation result shows that DeUEDroid can construct scene graph accurately, and achieve the accuracy scores of 77.70% on the five-classification task (i.e., gambling game, porn, financial scam, miscellaneous, and legitimate apps), reaching obvious improvements over the SOTA approaches. Running further on 24, 017 apps, DeUEDroid performs well in the real-world scenario to mitigate the threat. Specifically, by using DeUEDroid, we found that UEware are prevalent, i.e., 61% apps in the wild and 21% apps in the app stores are UEware (with over 72% accuracy after the manual investigation). We will release our dataset and system to engage the community after been accepted.


title: Muon Collider Forum Report

abstract: A multi-TeV muon collider offers a spectacular opportunity in the direct exploration of the energy frontier. Offering a combination of unprecedented energy collisions in a comparatively clean leptonic environment, a high energy muon collider has the unique potential to provide both precision measurements and the highest energy reach in one machine that cannot be paralleled by any currently available technology. The topic generated a lot of excitement in Snowmass meetings and continues to attract a large number of supporters, including many from the early career community. In light of this very strong interest within the US particle physics community, Snowmass Energy, Theory and Accelerator Frontiers created a cross-frontier Muon Collider Forum in November of 2020. The Forum has been meeting on a monthly basis and organized several topical workshops dedicated to physics, accelerator technology, and detector R&D. Findings of the Forum are summarized in this report.


title: Kinova Gemini: Interactive Robot Grasping with Visual Reasoning and Conversational AI

abstract: To facilitate recent advances in robotics and AI for delicate collaboration between humans and machines, we propose the Kinova Gemini, an original robotic system that integrates conversational AI dialogue and visual reasoning to make the Kinova Gen3 lite robot help people retrieve objects or complete perception-based pick-and-place tasks. When a person walks up to Kinova Gen3 lite, our Kinova Gemini is able to fulfill the user's requests in three different applications: (1) It can start a natural dialogue with people to interact and assist humans to retrieve objects and hand them to the user one by one. (2) It detects diverse objects with YOLO v3 and recognize color attributes of the item to ask people if they want to grasp it via the dialogue or enable the user to choose which specific one is required. (3) It applies YOLO v3 to recognize multiple objects and let you choose two items for perception-based pick-and-place tasks such as "Put the banana into the bowl" with visual reasoning and conversational interaction.


title: Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglement

abstract: Over the last few decades, many aspects of human life have been enhanced with virtual domains, from the advent of digital assistants such as Amazon's Alexa and Apple's Siri to the latest metaverse efforts of the rebranded Meta. These trends underscore the importance of generating photorealistic visual depictions of humans. This has led to the rapid growth of so-called deepfake and talking-head generation methods in recent years. Despite their impressive results and popularity, they usually lack certain qualitative aspects such as texture quality, lips synchronization, or resolution, and practical aspects such as the ability to run in real-time. To allow for virtual human avatars to be used in practical scenarios, we propose an end-to-end framework for synthesizing high-quality virtual human faces capable of speaking with accurate lip motion with a special emphasis on performance. We introduce a novel network utilizing visemes as an intermediate audio representation and a novel data augmentation strategy employing a hierarchical image synthesis approach that allows disentanglement of the different modalities used to control the global head motion. Our method runs in real-time, and is able to deliver superior results compared to the current state-of-the-art.


title: Deep Stable Representation Learning on Electronic Health Records

abstract: Deep learning models have achieved promising disease prediction performance of the Electronic Health Records (EHR) of patients. However, most models developed under the I.I.D. hypothesis fail to consider the agnostic distribution shifts, diminishing the generalization ability of deep learning models to Out-Of-Distribution (OOD) data. In this setting, spurious statistical correlations that may change in different environments will be exploited, which can cause sub-optimal performances of deep learning models. The unstable correlation between procedures and diagnoses existed in the training distribution can cause spurious correlation between historical EHR and future diagnosis. To address this problem, we propose to use a causal representation learning method called Causal Healthcare Embedding (CHE). CHE aims at eliminating the spurious statistical relationship by removing the dependencies between diagnoses and procedures. We introduce the Hilbert-Schmidt Independence Criterion (HSIC) to measure the degree of independence between the embedded diagnosis and procedure features. Based on causal view analyses, we perform the sample weighting technique to get rid of such spurious relationship for the stable learning of EHR across different environments. Moreover, our proposed CHE method can be used as a flexible plug-and-play module that can enhance existing deep learning models on EHR. Extensive experiments on two public datasets and five state-of-the-art baselines unequivocally show that CHE can improve the prediction accuracy of deep learning models on out-of-distribution data by a large margin. In addition, the interpretability study shows that CHE could successfully leverage causal structures to reflect a more reasonable contribution of historical records for predictions.


title: Classifying Spatial Trajectories

abstract: We provide the first comprehensive study on how to classify trajectories using only their spatial representations, measured on 5 real-world data sets. Our comparison considers 20 distinct classifiers arising either as a KNN classifier of a popular distance, or as a more general type of classifier using a vectorized representation of each trajectory. We additionally develop new methods for how to vectorize trajectories via a data-driven method to select the associated landmarks, and these methods prove among the most effective in our study. These vectorized approaches are simple and efficient to use, and also provide state-of-the-art accuracy on an established transportation mode classification task. In all, this study sets the standard for how to classify trajectories, including introducing new simple techniques to achieve these results, and sets a rigorous standard for the inevitable future study on this topic.


title: Bergman-Szeg\H{o} asymptotic formulas and the strip problem

abstract: Identifying holomorphic functions by moment conditions is a classical problem. This paper explores ideas introduced by Tumanov in a well known paper on the strip problem, and building on the author's previous work, to show that weighted Bergman projections can be computed via asymptotic formulas involving Szeg\H{o} projections a fixed 1-dimensional family of curves. Various new operators are introduced; in addition, similar formulas are derived via dimension reduction, using the author's CR Hartogs theorem.


title: Hall Sensor Based Measurements of the Magnetic Phase Diagram of Superconducting Vanadium

abstract: Vanadium is an elemental type-II superconductor which has a pure superconducting phase, a vortex phase, and a non-superconducting phase. We designed and carried out a low-budget experiment in our undergraduate physics lab to measure the magnetic field a close distance from the surface of a pure Vanadium disk sample isothermally with a Hall sensor across a range of different temperatures and external magnetic fields. We then used these measurements to compute the superconducting phase diagram of Vanadium. After completing measurements at eight temperatures ranging from 2.6K to 5K and magnetic fields ranging from -0.2T to 0.2T, we were able to detect the Meissner phase (clearly), and a vortex phase (less clearly). Using the graphs of the hall bar magnetic field versus external magnetic field, we were able to derive a rough estimate for the upper critical field and the lower critical field of Vanadium at the eight temperatures wherein we conducted measurements. The results are in general accord with the phase diagram of Vanadium found in the literature, except that the critical temperature appears to be less than 5.43K and 5.13K (about 4.8K). Further, we observed critical fields lower than those found in the literature. We hypothesize this is due mostly to impurities in our Vanadium sample (purchased through Amazon.com), which would reduce the measured critical temperature below that of pure Vanadium, consistent with our results.


title: Quasi-supervised Learning for Super-resolution PET

abstract: Low resolution of positron emission tomography (PET) limits its diagnostic performance. Deep learning has been successfully applied to achieve super-resolution PET. However, commonly used supervised learning methods in this context require many pairs of low- and high-resolution (LR and HR) PET images. Although unsupervised learning utilizes unpaired images, the results are not as good as that obtained with supervised deep learning. In this paper, we propose a quasi-supervised learning method, which is a new type of weakly-supervised learning methods, to recover HR PET images from LR counterparts by leveraging similarity between unpaired LR and HR image patches. Specifically, LR image patches are taken from a patient as inputs, while the most similar HR patches from other patients are found as labels. The similarity between the matched HR and LR patches serves as a prior for network construction. Our proposed method can be implemented by designing a new network or modifying an existing network. As an example in this study, we have modified the cycle-consistent generative adversarial network (CycleGAN) for super-resolution PET. Our numerical and experimental results qualitatively and quantitatively show the merits of our method relative to the state-ofthe-art methods. The code is publicly available at https://github.com/PigYang-ops/CycleGAN-QSDL.


title: Continual Learning for Steganalysis

abstract: To detect the existing steganographic algorithms, recent steganalysis methods usually train a Convolutional Neural Network (CNN) model on the dataset consisting of corresponding paired cover/stego-images. However, it is inefficient and impractical for those steganalysis tools to completely retrain the CNN model to make it effective against both the existing steganographic algorithms and a new emerging steganographic algorithm. Thus, existing steganalysis models usually lack dynamic extensibility for new steganographic algorithms, which limits their application in real-world scenarios. To address this issue, we propose an accurate parameter importance estimation (APIE) based-continual learning scheme for steganalysis. In this scheme, when a steganalysis model is trained on the new image dataset generated by the new steganographic algorithm, its network parameters are effectively and efficiently updated with sufficient consideration of their importance evaluated in the previous training process. This approach can guide the steganalysis model to learn the patterns of the new steganographic algorithm without significantly degrading the detectability against the previous steganographic algorithms. Experimental results demonstrate the proposed scheme has promising extensibility for new emerging steganographic algorithms.


title: Semi-Supervised Semantic Segmentation with Cross Teacher Training

abstract: Convolutional neural networks can achieve remarkable performance in semantic segmentation tasks. However, such neural network approaches heavily rely on costly pixel-level annotation. Semi-supervised learning is a promising resolution to tackle this issue, but its performance still far falls behind the fully supervised counterpart. This work proposes a cross-teacher training framework with three modules that significantly improves traditional semi-supervised learning approaches. The core is a cross-teacher module, which could simultaneously reduce the coupling among peer networks and the error accumulation between teacher and student networks. In addition, we propose two complementary contrastive learning modules. The high-level module can transfer high-quality knowledge from labeled data to unlabeled ones and promote separation between classes in feature space. The low-level module can encourage low-quality features learning from the high-quality features among peer networks. In experiments, the cross-teacher module significantly improves the performance of traditional student-teacher approaches, and our framework outperforms stateof-the-art methods on benchmark datasets. Our source code of CTT will be released.


title: Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods

abstract: The Robbins estimator is the most iconic and widely used procedure in the empirical Bayes literature for the Poisson model. On one hand, this method has been recently shown to be minimax optimal in terms of the regret (excess risk over the Bayesian oracle that knows the true prior) for various nonparametric classes of priors. On the other hand, it has been long recognized in practice that Robbins estimator lacks the desired smoothness and monotonicity of Bayes estimators and can be easily derailed by those data points that were rarely observed before. Based on the minimum-distance distance method, we propose a suite of empirical Bayes estimators, including the classical nonparametric maximum likelihood, that outperform the Robbins method in a variety of synthetic and real data sets and retain its optimality in terms of minimax regret.


title: Power Allocation for Space-Terrestrial Cooperation Systems with Statistical CSI

abstract: This paper studies an integrated network design that boosts system capacity through cooperation between wireless access points (APs) and a satellite. By coherently combing the signals received by the central processing unit from the users through the space and terrestrial links, we mathematically derive an achievable throughput expression for the uplink (UL) data transmission over spatially correlated Rician channels. A closed-form expression is obtained when maximum ratio combining is employed to detect the desired signals. We formulate the max-min fairness and total transmit power optimization problems relying on the channel statistics to perform power allocation. The solution of each optimization problem is derived in form of a low-complexity iterative design, in which each data power variable is updated based on a closed-form expression. The mathematical analysis is validated with numerical results showing the added benefits of considering a satellite link in terms of improving the ergodic data throughput.


title: Child labour and schooling decision of the marginal farmer households: An empirical evidence from the East Medinipur district of West Bengal, India

abstract: Based on the field investigation of West Bengal, this paper investigates whether the school-aged children of the marginal farmer households are full-time paid labourers or unpaid domestic labourers along with schooling or regular students. Probit Regression analysis is applied here to assess the influencing factors for reducing the size of the child labour force in practice. The result shows that the higher is the earning of the adult members of the households, the lower is the incidence of child labour. Moreover, the credit accessibility of the mother from the Self-help group and more person-days of the father in work in a reference year are also responsible for reducing the possibility of a child turning into labour. The study further suggests that the younger age of the father, father's education, and low operational landholdings are positive and significant determinants to decide on a child's education by restricting their excessive domestic work burden.


title: Optimal time-decay estimates for a diffusive Oldroyd-B model

abstract: In this paper, we study the optimal time decay rates for the higher order spatial derivatives of solutions to a diffusive Oldroyd-B model. As pointed out in the Section 1.2 of Huang-Wang-Wen-Zi (J. Differential Equations 306: 456-491, 2022), how to estiblish the optimal decay estimate for the highest-order spatial derivatives of the solution to this model is still an open problem. Motivated by Wang-Wen (Sci. China Math. 65: 1199-1228, 2022), we give a positive answer to this problem via some delicate analyses on the low and high frequency parts of the solution.


title: Class-Specific Channel Attention for Few-Shot Learning

abstract: Few-Shot Learning (FSL) has attracted growing attention in computer vision due to its capability in model training without the need for excessive data. FSL is challenging because the training and testing categories (the base vs. novel sets) can be largely diversified. Conventional transfer-based solutions that aim to transfer knowledge learned from large labeled training sets to target testing sets are limited, as critical adverse impacts of the shift in task distribution are not adequately addressed. In this paper, we extend the solution of transfer-based methods by incorporating the concept of metric-learning and channel attention. To better exploit the feature representations extracted by the feature backbone, we propose Class-Specific Channel Attention (CSCA) module, which learns to highlight the discriminative channels in each class by assigning each class one CSCA weight vector. Unlike general attention modules designed to learn global-class features, the CSCA module aims to learn local and class-specific features with very effective computation. We evaluated the performance of the CSCA module on standard benchmarks including miniImagenet, Tiered-ImageNet, CIFAR-FS, and CUB-200-2011. Experiments are performed in inductive and in/cross-domain settings. We achieve new state-of-the-art results.


title: LDP-FPMiner: FP-Tree Based Frequent Itemset Mining with Local Differential Privacy

abstract: Data aggregation in the setting of local differential privacy (LDP) guarantees strong privacy by providing plausible deniability of sensitive data. Existing works on this issue mostly focused on discovering heavy hitters, leaving the task of frequent itemset mining (FIM) as an open problem. To the best of our knowledge, the-state-of-the-art LDP solution to FIM is the SVSM protocol proposed recently. The SVSM protocol is mainly based on the padding and sampling based frequency oracle (PSFO) protocol, and regarded an itemset as an independent item without considering the frequency consistency among itemsets. In this paper, we propose a novel LDP approach to FIM called LDP-FPMiner based on frequent pattern tree (FP-tree). Our proposal exploits frequency consistency among itemsets by constructing and optimizing a noisy FP-tree with LDP. Specifically, it works as follows. First, the most frequent items are identified, and the item domain is cut down accordingly. Second, the maximum level of the FP-tree is estimated. Third, a noisy FP-tree is constructed and optimized by using itemset frequency consistency, and then mined to obtain the k most frequent itemsets. Experimental results show that the LDP-FPMiner significantly improves over the state-of-the-art approach, SVSM, especially in the case of a high privacy level.


title: Noise-Robust Bidirectional Learning with Dynamic Sample Reweighting

abstract: Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an extremely slow model convergence speed. In this paper, we first introduce a bidirectional learning scheme, where positive learning ensures convergence speed while negative learning robustly copes with label noise. Further, a dynamic sample reweighting strategy is proposed to globally weaken the effect of noise-labeled samples by exploiting the excellent discriminatory ability of negative learning on the sample probability distribution. In addition, we combine self-distillation to further improve the model performance. The code is available at \url{https://github.com/chenchenzong/BLDR}.


title: Neural Approaches to Multilingual Information Retrieval

abstract: Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the multilingual (MLIR) task to create a single ranked list of documents across many languages is considerably more challenging. This paper investigates whether advances in neural document translation and pretrained multilingual neural language models enable improvements in the state of the art over earlier MLIR techniques. The results show that although combining neural document translation with neural ranking yields the best Mean Average Precision (MAP), 98% of that MAP score can be achieved with an 84% reduction in indexing time by using a pretrained XLM-R multilingual language model to index documents in their native language, and that 2% difference in effectiveness is not statistically significant. Key to achieving these results for MLIR is to fine-tune XLM-R using mixed-language batches from neural translations of MS MARCO passages.


title: Graph Fourier transforms on directed product graphs

abstract: Graph Fourier transform (GFT) is one of the fundamental tools in graph signal processing to decompose graph signals into different frequency components and to represent graph signals with strong correlation by different modes of variation effectively. The GFT on undirected graphs has been well studied and several approaches have been proposed to define GFTs on directed graphs. In this paper, based on the singular value decompositions of some graph Laplacians, we propose two GFTs on the Cartesian product graph of two directed graphs. We show that the proposed GFTs could represent spatial-temporal data sets on directed networks with strong correlation efficiently, and in the undirected graph setting they are essentially the joint GFT in the literature. In this paper, we also consider the bandlimiting procedure in the spectral domain of the proposed GFTs, and demonstrate its performance to denoise the temperature data set in the region of Brest (France) on January 2014.


title: Mobility edge in long-range interacting many-body localized systems

abstract: As disorder strength increases in quantum many-body systems a new phase of matter, the so-called anybody localization, emerges across the whole spectrum. This transition is energy dependent, a phenomenon known as mobility edge, such that the mid-spectrum eigenstates tend to localize at larger values of disorder in comparison to eigenstates near the edges of the spectrum. Many-body localization becomes more sophisticated in long-range interacting systems. Here, by focusing on several quantities, we draw the phase diagram as a function of disorder strength and energy spectrum, for a various range of interactions. Regardless of the underlying transition type, either second-order or Kosterlitz-Thouless, our analysis consistently determines the mobility edge, i.e. the phase boundary across the spectrum. We show that long-range interaction enhances the localization effect and shifts the phase boundary towards smaller values of disorder. In addition, we establish a hierarchy among the studied quantities concerning their corresponding transition boundary and critical exponents. Interestingly, we show that deliberately discarding some information of the system can mitigate finite-size effects and provide results in line with the analytical predictions at the thermodynamic limit.


title: FedAR+: A Federated Learning Approach to Appliance Recognition with Mislabeled Data in Residential Buildings

abstract: With the enhancement of people's living standards and rapid growth of communication technologies, residential environments are becoming smart and well-connected, increasing overall energy consumption substantially. As household appliances are the primary energy consumers, their recognition becomes crucial to avoid unattended usage, thereby conserving energy and making smart environments more sustainable. An appliance recognition model is traditionally trained at a central server (service provider) by collecting electricity consumption data, recorded via smart plugs, from the clients (consumers), causing a privacy breach. Besides that, the data are susceptible to noisy labels that may appear when an appliance gets connected to a non-designated smart plug. While addressing these issues jointly, we propose a novel federated learning approach to appliance recognition, called FedAR+, enabling decentralized model training across clients in a privacy preserving way even with mislabeled training data. FedAR+ introduces an adaptive noise handling method, essentially a joint loss function incorporating weights and label distribution, to empower the appliance recognition model against noisy labels. By deploying smart plugs in an apartment complex, we collect a labeled dataset that, along with two existing datasets, are utilized to evaluate the performance of FedAR+. Experimental results show that our approach can effectively handle up to $30\%$ concentration of noisy labels while outperforming the prior solutions by a large margin on accuracy.


title: DSE-GAN: Dynamic Semantic Evolution Generative Adversarial Network for Text-to-Image Generation

abstract: Text-to-image generation aims at generating realistic images which are semantically consistent with the given text. Previous works mainly adopt the multi-stage architecture by stacking generator-discriminator pairs to engage multiple adversarial training, where the text semantics used to provide generation guidance remain static across all stages. This work argues that text features at each stage should be adaptively re-composed conditioned on the status of the historical stage (i.e., historical stage's text and image features) to provide diversified and accurate semantic guidance during the coarse-to-fine generation process. We thereby propose a novel Dynamical Semantic Evolution GAN (DSE-GAN) to re-compose each stage's text features under a novel single adversarial multi-stage architecture. Specifically, we design (1) Dynamic Semantic Evolution (DSE) module, which first aggregates historical image features to summarize the generative feedback, and then dynamically selects words required to be re-composed at each stage as well as re-composed them by dynamically enhancing or suppressing different granularity subspace's semantics. (2) Single Adversarial Multi-stage Architecture (SAMA), which extends the previous structure by eliminating complicated multiple adversarial training requirements and therefore allows more stages of text-image interactions, and finally facilitates the DSE module. We conduct comprehensive experiments and show that DSE-GAN achieves 7.48\% and 37.8\% relative FID improvement on two widely used benchmarks, i.e., CUB-200 and MSCOCO, respectively.


title: Federated XGBoost on Sample-Wise Non-IID Data

abstract: Federated Learning (FL) is a paradigm for jointly training machine learning algorithms in a decentralized manner which allows for parties to communicate with an aggregator to create and train a model, without exposing the underlying raw data distribution of the local parties involved in the training process. Most research in FL has been focused on Neural Network-based approaches, however Tree-Based methods, such as XGBoost, have been underexplored in Federated Learning due to the challenges in overcoming the iterative and additive characteristics of the algorithm. Decision tree-based models, in particular XGBoost, can handle non-IID data, which is significant for algorithms used in Federated Learning frameworks since the underlying characteristics of the data are decentralized and have risks of being non-IID by nature. In this paper, we focus on investigating the effects of how Federated XGBoost is impacted by non-IID distributions by performing experiments on various sample size-based data skew scenarios and how these models perform under various non-IID scenarios. We conduct a set of extensive experiments across multiple different datasets and different data skew partitions. Our experimental results demonstrate that despite the various partition ratios, the performance of the models stayed consistent and performed close to or equally well against models that were trained in a centralized manner.


title: Generative Modeling via Tree Tensor Network States

abstract: In this paper, we present a density estimation framework based on tree tensor-network states. The proposed method consists of determining the tree topology with Chow-Liu algorithm, and obtaining a linear system of equations that defines the tensor-network components via sketching techniques. Novel choices of sketch functions are developed in order to consider graphical models that contain loops. Sample complexity guarantees are provided and further corroborated by numerical experiments.


title: The Elusive High-Tc Superinductor

abstract: Ginzburg-Landau (GL) parameters formed the basis for Abrikosov discovery of the quantum vortex of a supercurrent in type-II superconductor with a normal core of size $\xi$, the superconductor coherence length and circulating supercurrent induced magnetic field diverging as $log(1/r)$ from the core with a decay length of the London penetration depth, $\lambda_L.$ In 1964, J. Pearl predicted the slowly decaying $(1/r^2)$ field around a vortex spreading out to Pearl length, $P_L=2\lambda_L^2/t$, in a superconductor film of thickness $t < \lambda_L$. However, his quintessential theory failed to predict the existence of giant kinetic inductance (GKI) that arises from the enlarged screening currents of the vortex. Here, we discover giant kinetic inductance in a $high-T_c$ metasurface due to the 1400% expansion of the vortex screening supercurrent from $\lambda_L$ to 14$\lambda_L$ in ultrathin film meta-atom of $\lambda_L/7$ thickness, which leads to the emergence of terahertz superinductance possessing quantum impedance exceeding the resistance quantum limit of $R_Q=h/(2e)^2 =6.47 k\Omega$ by 33%. Our discovery presents a new class of $high-T_c$ superconductor electronic, photonic, and quantum devices enabled through metasurface designed at the Pearl length scales, providing novel applications in quantum circuitry, metrology, and single photon kinetic inductance detectors.


title: A remark on the nilpotent orbit theorem for unipotent complex variations of Hodge structure

abstract: We present a new proof of a part of the nilpotent orbit theorem for unipotent complex variations of Hodge structure. In our proof, the $L^2$ extension theorem of Ohsawa-Takegoshi type plays an essential role.


title: Real Analytic Bergman Spaces

abstract: The usual examples of Bergman spaces consist of the closure of an algebra of holomorphic functions on a domain. One can also take the real part of such functions, but essentially one is looking at the same object. In this paper the author shows that the properties of real analyticity and bounded point evaluation can be preserved under closure in a weighted $L^p$ space, if one takes the algebra generated by $z$ and $(\bar z)g(z)$, where $g$ is an entire function satisfying some condition on the distribution of zeros near $\infty$. The condition is not difficult to satisfy with simple examples. The resulting spaces are much larger than the ordinary Bergman spaces. The main example is with a Gaussian weight like the Fock space. One can get good approximation of the usual Fock space by a sequence of these real analytic Bergman spaces.


title: How To Start a Grassroots Movement

abstract: We study the influence of social messages that promote a digital public good, a COVID-19 tracing app. We vary whether subjects receive a digital message from another subject, and, if so, at what cost it came. Observed maximum willingness to invest in sending varies, from 1 cent up to 20 euros. Does this affect receivers' sending behavior? Willingness to invest in sending increases when previously receiving the message. Yet, cost signals have no impact. Thus, grassroots movements can be started at virtually no cost. App-support matters normatively as non-supporters are supposed to be punished in triage.


title: HammingMesh: A Network Topology for Large-Scale Deep Learning

abstract: Numerous microarchitectural optimizations unlocked tremendous processing power for deep neural networks that in turn fueled the AI revolution. With the exhaustion of such optimizations, the growth of modern AI is now gated by the performance of training systems, especially their data movement. Instead of focusing on single accelerators, we investigate data-movement characteristics of large-scale training at full system scale. Based on our workload analysis, we design HammingMesh, a novel network topology that provides high bandwidth at low cost with high job scheduling flexibility. Specifically, HammingMesh can support full bandwidth and isolation to deep learning training jobs with two dimensions of parallelism. Furthermore, it also supports high global bandwidth for generic traffic. Thus, HammingMesh will power future large-scale deep learning systems with extreme bandwidth requirements.


abstract: Recently, contrastive learning has been applied to the sequential recommendation task to address data sparsity caused by users with few item interactions and items with few user adoptions. Nevertheless, the existing contrastive learning-based methods fail to ensure that the positive (or negative) sequence obtained by some random augmentation (or sequence sampling) on a given anchor user sequence remains to be semantically similar (or different). When the positive and negative sequences turn out to be false positive and false negative respectively, it may lead to degraded recommendation performance. In this work, we address the above problem by proposing Explanation Guided Augmentations (EGA) and Explanation Guided Contrastive Learning for Sequential Recommendation (EC4SRec) model framework. The key idea behind EGA is to utilize explanation method(s) to determine items' importance in a user sequence and derive the positive and negative sequences accordingly. EC4SRec then combines both self-supervised and supervised contrastive learning over the positive and negative sequences generated by EGA operations to improve sequence representation learning for more accurate recommendation results. Extensive experiments on four real-world benchmark datasets demonstrate that EC4SRec outperforms the state-of-the-art sequential recommendation methods and two recent contrastive learning-based sequential recommendation methods, CL4SRec and DuoRec. Our experiments also show that EC4SRec can be easily adapted for different sequence encoder backbones (e.g., GRU4Rec and Caser), and improve their recommendation performance.


title: How to cut a discrete cake fairly

abstract: Cake-cutting is a fundamental model of dividing a heterogeneous resource, such as land, broadcast time, and advertisement space. In this study, we consider the problem of dividing a discrete cake fairly in which the indivisible goods are aligned on a path and agents are interested in receiving a connected subset of items. We prove that a connected division of indivisible items satisfying a discrete counterpart of envy-freeness, called envy-freeness up to one good (EF1), always exists for any number of agents n with monotone valuations. Our result settles an open question raised by Bil\`o et al. (2019), who proved that an EF1 connected division always exists for the number of agents at most 4. Moreover, the proof can be extended to show the following (1) secretive and (2) extra versions: (1) for n agents with monotone valuations, the path can be divided into n connected bundles such that an EF1 assignment of the remaining bundles can be made to the other agents for any selection made by the secretive agent; (2) for n+1 agents with monotone valuations, the path can be divided into n connected bundles such that when any extra agent leaves, an EF1 assignment of the bundles can be made to the remaining agents.


title: Towards the Age of Intelligent Vehicular Networks for Connected and Autonomous Vehicles in 6G

abstract: Twenty-two years after the advent of the first-generation vehicular network, i.e., dedicated short-range communications (DSRC) standard/IEEE 802.11p, the vehicular technology market has become very competitive with a new player, Cellular Vehicle-to-Everything (C-V2X). Currently, C-V2X technology likely dominates the race because of the big advantages of comprehensive coverage and high throughput/reliability. Meanwhile, DSRC-based technologies are struggling to survive and rebound with many hopes betting on the success of the second-generation standard, IEEE P802.11bd. While the standards battle to attract automotive makers and dominate the commercial market landing, the research community has started thinking about the shape of the next-generation vehicular networks. This article details the state-of-the-art progress of vehicular networks, particularly the cellular V2X-related technologies in specific use cases, compared to the features of the current generation. Through the typical examples, we also highlight why 5G is inadequate to provide the best connectivity for vehicular applications, and then 6G technologies can fill up the vacancy.


title: Semi-supervised Training for Knowledge Base Graph Self-attention Networks on Link Prediction

abstract: The task of link prediction aims to solve the problem of incomplete knowledge caused by the difficulty of collecting facts from the real world. GCNs-based models are widely applied to solve link prediction problems due to their sophistication, but GCNs-based models are suffering from two problems in the structure and training process. 1) The transformation methods of GCN layers become increasingly complex in GCN-based knowledge representation models; 2) Due to the incompleteness of the knowledge graph collection process, there are many uncollected true facts in the labeled negative samples. Therefore, this paper investigates the characteristic of the information aggregation coefficient (self-attention) of adjacent nodes and redesigns the self-attention mechanism of the GAT structure. Meanwhile, inspired by human thinking habits, we designed a semi-supervised self-training method over pre-trained models. Experimental results on the benchmark datasets FB15k-237 and WN18RR show that our proposed self-attention mechanism and semi-supervised self-training method can effectively improve the performance of the link prediction task. If you look at FB15k-237, for example, the proposed method improves Hits@1 by about 30%.


title: Redetermination of the Parameters of the Galactic Spiral Pattern from Classical Cepheids

abstract: We have studied a sample of Galactic classical Cepheids with their distance estimates taken from Skowron et al. (2019), where they were determined based on the period-luminosity relation. In this paper the Skowron et al. (2019) distances were increased by 10\%, according to the results of our kinematic analysis of these Cepheids obtained by us previously. We have refined the geometric characteristics of two spiral arms: the Carina-Sagittarius and Outer ones. The Galactocentric distance of the Sun was assumed to be $8.1\pm0.1$~kpc. Based on 257 Cepheids belonging to a Carina-Sagittarius arm segment with ages in the range 80--120 Myr, we have found the pitch angle of the spiral pattern $i=-12.7\pm0.4^\circ$ and the position of this arm $a_0=7.28\pm0.05$~kpc. Based on 352 Cepheids from the Outer arm with ages in the range 120--300 Myr, we have found $i=-12.0\pm0.5^\circ$ and $a_0=13.03\pm0.06$~kpc. Based on a sample of 1618 Cepheids with ages in the range 80--300 Myr, we have constructed a wavelet map in the ``position angle--logarithm of distance'' plane. The following estimates have been obtained from our analysis of this map: $i=-12.9\pm0.4^\circ$ and $a_0=7.43\pm0.05$~kpc for the Carina-Sagittarius arm and $i=-12.5\pm0 .5^\circ$ and $a_0=13.33\pm0.06$~kpc for the Outer arm. We have found that the Sun is very close to the corotation radius that is located between the Sun and the Perseus arm and estimates the angular rotation speed of the spiral pattern $\Omega_p = 27\pm1$ km s$^{-1}$ kpc$^{-1}$.


title: Improving Compositional Generalization in Math Word Problem Solving

abstract: Compositional generalization refers to a model's capability to generalize to newly composed input data based on the data components observed during training. It has triggered a series of compositional generalization analysis on different tasks as generalization is an important aspect of language and problem solving skills. However, the similar discussion on math word problems (MWPs) is limited. In this manuscript, we study compositional generalization in MWP solving. Specifically, we first introduce a data splitting method to create compositional splits from existing MWP datasets. Meanwhile, we synthesize data to isolate the effect of compositions. To improve the compositional generalization in MWP solving, we propose an iterative data augmentation method that includes diverse compositional variation into training data and could collaborate with MWP methods. During the evaluation, we examine a set of methods and find all of them encounter severe performance loss on the evaluated datasets. We also find our data augmentation method could significantly improve the compositional generalization of general MWP methods. Code is available at https://github.com/demoleiwang/CGMWP.


title: A repeated unknown game: Decentralized task offloading in vehicular fog computing

abstract: Offloading computation to nearby edge/fog computing nodes, including the ones carried by moving vehicles, e.g., vehicular fog nodes (VFN), has proved to be a promising approach for enabling low-latency and compute-intensive mobility applications, such as cooperative and autonomous driving. This work considers vehicular fog computing scenarios where the clients of computation offloading services try to minimize their own costs while deciding which VFNs to offload their tasks. We focus on decentralized multi-agent decision-making in a repeated unknown game where each agent, e.g., service client, can observe only its own action and realized cost. In other words, each agent is unaware of the game composition or even the existence of opponents. We apply a completely uncoupled learning rule to generalize the decentralized decision-making algorithm presented in \cite{Cho2021} for the multi-agent case. The multi-agent solution proposed in this work can capture the unknown offloading cost variations susceptive to resource congestion under an adversarial framework where each agent may take implicit cost estimation and suitable resource choice adapting to the dynamics associated with volatile supply and demand. According to the evaluation via simulation, this work reveals that such individual perturbations for robustness to uncertainty and adaptation to dynamicity ensure a certain level of optimality in terms of social welfare, e.g., converging the actual sequence of play with unknown and asymmetric attributes and lowering the correspondent cost in social welfare due to the self-interested behaviors of agents.


title: Numerical simulation using cellular Potts model for wound closure with ATP release and the mechanobioligical effects

abstract: To computationally investigate the recent experimental finding such that extracellular ATP release caused by exogeneous mechanical forces promote wound closure, we introduce a mathematical model, the Cellular Pots Model (CPM), which is a popular discretized model on a lattice, where the movement of a "cell" is determined by a Monte Carlo procedure. In the experiment, it was observed that there is mechanosensitive ATP release from the leading cells facing the wound gap and the subsequent intracellular Ca$^{2+}$ influx. To model these phenomena, the Reaction-Diffusion equations for ATP and Ca$^{2+}$ concentrations are adopted and combined with CPM, where we also add a polarity term because the cell migration is enhanced in the case of ATP release. From the numerical simulations using his hybrid model, we discuss effects of the collective cell migration due to the ATP release and the Ca${}^{2+}$ influx caused by the mechanical forces and the consequent promotion of wound closure.


title: Semantic Segmentation in Learned Compressed Domain

abstract: Most machine vision tasks (e.g., semantic segmentation) are based on images encoded and decoded by image compression algorithms (e.g., JPEG). However, these decoded images in the pixel domain introduce distortion, and they are optimized for human perception, making the performance of machine vision tasks suboptimal. In this paper, we propose a method based on the compressed domain to improve segmentation tasks. i) A dynamic and a static channel selection method are proposed to reduce the redundancy of compressed representations that are obtained by encoding. ii) Two different transform modules are explored and analyzed to help the compressed representation be transformed as the features in the segmentation network. The experimental results show that we can save up to 15.8\% bitrates compared with a state-of-the-art compressed domain-based work while saving up to about 83.6\% bitrates and 44.8\% inference time compared with the pixel domain-based method.


title: Masked Sinogram Model with Transformer for ill-Posed Computed Tomography Reconstruction: a Preliminary Study

abstract: Computed Tomography (CT) is an imaging technique where information about an object are collected at different angles (called projections or scans). Then the cross-sectional image showing the internal structure of the slice is produced by solving an inverse problem. Limited by certain factors such as radiation dosage, projection angles, the produced images can be noisy or contain artifacts. Inspired by the success of transformer for natural language processing, the core idea of this preliminary study is to consider a projection of tomography as a word token, and the whole scan of the cross-section (A.K.A. sinogram) as a sentence in the context of natural language processing. Then we explore the idea of foundation model by training a masked sinogram model (MSM) and fine-tune MSM for various downstream applications including CT reconstruction under data collections restriction (e.g., photon-budget) and a data-driven solution to approximate solutions of the inverse problem for CT reconstruction. Models and data used in this study are available at https://github.com/lzhengchun/TomoTx.


title: DualCam: A Novel Benchmark Dataset for Fine-grained Real-time Traffic Light Detection

abstract: Traffic light detection is essential for self-driving cars to navigate safely in urban areas. Publicly available traffic light datasets are inadequate for the development of algorithms for detecting distant traffic lights that provide important navigation information. We introduce a novel benchmark traffic light dataset captured using a synchronized pair of narrow-angle and wide-angle cameras covering urban and semi-urban roads. We provide 1032 images for training and 813 synchronized image pairs for testing. Additionally, we provide synchronized video pairs for qualitative analysis. The dataset includes images of resolution 1920$\times$1080 covering 10 different classes. Furthermore, we propose a post-processing algorithm for combining outputs from the two cameras. Results show that our technique can strike a balance between speed and accuracy, compared to the conventional approach of using a single camera frame.


title: Machine learning based approach for solving atomic structures of nanomaterials combining pair distribution functions with density functional theory

abstract: Determination of crystal structures of nanocrystalline or amorphous compounds is a great challenge in solid states chemistry and physics. Pair distribution function (PDF) analysis of X-Ray or neutron total scattering data has proven to be a key element in tackling this challenge. However, in most cases a reliable structural motif is needed as starting configuration for structure refinements. Here, we present an algorithm that is able to determine the crystal structure of an unknown compound by means of an on-the-fly trained machine learning model that combines density functional theory (DFT) calculations with comparison of calculated and measured PDFs for global optimization in an artificial landscape. Due to the nature of this landscape, even metastable configurations can be determined.


title: Gravitational wave source clustering in the luminosity distance space with the presence of peculiar velocity and lensing errors

abstract: GW number count can be used as a novel tracer of the large scale structure (LSS) in the luminosity distance space (LDS), just like galaxies in the redshift space. It is possible to obtain the $D_L-D_A$ duality relation with clustering effect. However, several LSS induced errors will contaminate the GW luminosity distance measurement, such as the peculiar velocity dispersion error of the host galaxy as well as the foreground lensing magnification. The distance uncertainties induced from these effects will degrade the GW clustering from a spectroscopic-like data down to a photometric-like data. In this paper, we investigate how these LSS induced distance errors modify our cosmological parameter precision inferred from the LDS clustering. We consider two of the next generation GW observatories, namely the Big Bang Observatory (BBO) and the Einstein Telescope (ET). We forecast the parameter estimation errors on the angular diameter distance $D_A$, luminosity distance space Hubble parameter $H_L$ and structure growth rate $f_L\sigma_8$ with a Fisher matrix method. Generally speaking, the GW source clustering data can be used for cosmological studies below $D_L<5$ Gpc, while above this scale the lensing errors will increase significantly. We find that for BBO, it is possible to constrain the cosmological parameters with a relative error of $10^{-3}$ to $10^{-2}$ below $D_L<5$ Gpc. The velocity dispersion error is dominant in the low luminosity distance range, while the lensing magnification error is the bottleneck in the large luminosity distance range. To reduce the lensing error, we assumed a $50\%$ delensing efficiency. Even with this optimal assumption, the fractional error increased to $O(1)$ at luminosity distance $D_L=25$ Gpc. The results for ET are similar as those from BBO. Due to the GW source number in ET is less than that from BBO, the corresponding results also get a bit worse.