title: A Computational Information Criterion for Particle-Tracking with Sparse or Noisy Data

abstract: Traditional probabilistic methods for the simulation of advection-diffusion equations (ADEs) often overlook the entropic contribution of the discretization, e.g., the number of particles, within associated numerical methods. Many times, the gain in accuracy of a highly discretized numerical model is outweighed by its associated computational costs or the noise within the data. We address the question of how many particles are needed in a simulation to best approximate and estimate parameters in one-dimensional advective-diffusive transport. To do so, we use the well-known Akaike Information Criterion (AIC) and a recently-developed correction called the Computational Information Criterion (COMIC) to guide the model selection process. Random-walk and mass-transfer particle tracking methods are employed to solve the model equations at various levels of discretization. Numerical results demonstrate that the COMIC provides an optimal number of particles that can describe a more efficient model in terms of parameter estimation and model prediction compared to the model selected by the AIC even when the data is sparse or noisy, the sampling volume is not uniform throughout the physical domain, or the error distribution of the data is non-IID Gaussian.


title: User Acceptance of Gender Stereotypes in Automated Career Recommendations

abstract: Currently, there is a surge of interest in fair Artificial Intelligence (AI) and Machine Learning (ML) research which aims to mitigate discriminatory bias in AI algorithms, e.g. along lines of gender, age, and race. While most research in this domain focuses on developing fair AI algorithms, in this work, we show that a fair AI algorithm on its own may be insufficient to achieve its intended results in the real world. Using career recommendation as a case study, we build a fair AI career recommender by employing gender debiasing machine learning techniques. Our offline evaluation showed that the debiased recommender makes fairer career recommendations without sacrificing its accuracy. Nevertheless, an online user study of more than 200 college students revealed that participants on average prefer the original biased system over the debiased system. Specifically, we found that perceived gender disparity is a determining factor for the acceptance of a recommendation. In other words, our results demonstrate we cannot fully address the gender bias issue in AI recommendations without addressing the gender bias in humans.


title: Reducing Effects of Swath Gaps on Unsupervised Machine Learning Models for NASA MODIS Instruments

abstract: Due to the nature of their pathways, NASA Terra and NASA Aqua satellites capture imagery containing swath gaps, which are areas of no data. Swath gaps can overlap the region of interest (ROI) completely, often rendering the entire imagery unusable by Machine Learning (ML) models. This problem is further exacerbated when the ROI rarely occurs (e.g. a hurricane) and, on occurrence, is partially overlapped with a swath gap. With annotated data as supervision, a model can learn to differentiate between the area of focus and the swath gap. However, annotation is expensive and currently the vast majority of existing data is unannotated. Hence, we propose an augmentation technique that considerably removes the existence of swath gaps in order to allow CNNs to focus on the ROI, and thus successfully use data with swath gaps for training. We experiment on the UC Merced Land Use Dataset, where we add swath gaps through empty polygons (up to 20 percent areas) and then apply augmentation techniques to fill the swath gaps. We compare the model trained with our augmentation techniques on the swath gap-filled data with the model trained on the original swath gap-less data and note highly augmented performance. Additionally, we perform a qualitative analysis using activation maps that visualizes the effectiveness of our trained network in not paying attention to the swath gaps. We also evaluate our results with a human baseline and show that, in certain cases, the filled swath gaps look so realistic that even a human evaluator did not distinguish between original satellite images and swath gap-filled images. Since this method is aimed at unlabeled data, it is widely generalizable and impactful for large scale unannotated datasets from various space data domains.


title: Intelligent Agent for Hurricane Emergency Identification and Text Information Extraction from Streaming Social Media Big Data

abstract: This paper presents our research on leveraging social media Big Data and AI to support hurricane disaster emergency response. The current practice of hurricane emergency response for rescue highly relies on emergency call centres. The more recent Hurricane Harvey event reveals the limitations of the current systems. We use Hurricane Harvey and the associated Houston flooding as the motivating scenario to conduct research and develop a prototype as a proof-of-concept of using an intelligent agent as a complementary role to support emergency centres in hurricane emergency response. This intelligent agent is used to collect real-time streaming tweets during a natural disaster event, to identify tweets requesting rescue, to extract key information such as address and associated geocode, and to visualize the extracted information in an interactive map in decision supports. Our experiment shows promising outcomes and the potential application of the research in support of hurricane emergency response.


title: Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective

abstract: Multiple views of data, both naturally acquired (e.g., image and audio) and artificially produced (e.g., via adding different noise to data samples), have proven useful in enhancing representation learning. Natural views are often handled by multiview analysis tools, e.g., (deep) canonical correlation analysis [(D)CCA], while the artificial ones are frequently used in self-supervised learning (SSL) paradigms, e.g., BYOL and Barlow Twins. Both types of approaches often involve learning neural feature extractors such that the embeddings of data exhibit high cross-view correlations. Although intuitive, the effectiveness of correlation-based neural embedding is mostly empirically validated. This work aims to understand latent correlation maximization-based deep multiview learning from a latent component identification viewpoint. An intuitive generative model of multiview data is adopted, where the views are different nonlinear mixtures of shared and private components. Since the shared components are view/distortion-invariant, representing the data using such components is believed to reveal the identity of the samples effectively and robustly. Under this model, latent correlation maximization is shown to guarantee the extraction of the shared components across views (up to certain ambiguities). In addition, it is further shown that the private information in each view can be provably disentangled from the shared using proper regularization design. A finite sample analysis, which has been rare in nonlinear mixture identifiability study, is also presented. The theoretical results and newly designed regularization are tested on a series of tasks.


title: The Power of Randomization: Efficient and Effective Algorithms for Constrained Submodular Maximization

abstract: Submodular optimization has numerous applications such as crowdsourcing and viral marketing. In this paper, we study the fundamental problem of non-negative submodular function maximization subject to a $k$-system constraint, which generalizes many other important constraints in submodular optimization such as cardinality constraint, matroid constraint, and $k$-extendible system constraint. The existing approaches for this problem achieve the best-known approximation ratio of $k+2\sqrt{k+2}+3$ (for a general submodular function) based on deterministic algorithmic frameworks. We propose several randomized algorithms that improve upon the state-of-the-art algorithms in terms of approximation ratio and time complexity, both under the non-adaptive setting and the adaptive setting. The empirical performance of our algorithms is extensively evaluated in several applications related to data mining and social computing, and the experimental results demonstrate the superiorities of our algorithms in terms of both utility and efficiency.


title: Toward Diverse Precondition Generation

abstract: Language understanding must identify the logical connections between events in a discourse, but core events are often unstated due to their commonsense nature. This paper fills in these missing events by generating precondition events. Precondition generation can be framed as a sequence-to-sequence problem: given a target event, generate a possible precondition. However, in most real-world scenarios, an event can have several preconditions, requiring diverse generation -- a challenge for standard seq2seq approaches. We propose DiP, a Diverse Precondition generation system that can generate unique and diverse preconditions. DiP uses a generative process with three components -- an event sampler, a candidate generator, and a post-processor. The event sampler provides control codes (precondition triggers) which the candidate generator uses to focus its generation. Unlike other conditional generation systems, DiP automatically generates control codes without training on diverse examples. Analysis against baselines reveals that DiP improves the diversity of preconditions significantly while also generating more preconditions.


title: Large-scale asymmetry in galaxy spin directions: evidence from the Southern hemisphere

abstract: Recent observations using several different telescopes and sky surveys showed patterns of asymmetry in the distribution of galaxies by their spin directions as observed from Earth. These studies were done with data imaged from the Northern hemisphere, showing excellent agreement between different telescopes and different analysis methods. Here, data from the DESI Legacy Survey was used. The initial dataset contains $\sim2.2\cdot10^7$ galaxy images, reduced to $\sim8.1\cdot10^5$ galaxies annotated by their spin direction using a symmetric algorithm. That makes it not just the first analysis of its kind in which the majority of the galaxies are in the Southern hemisphere, but also by far the largest dataset used for this purpose to date. The results show strong agreement between opposite parts of the sky, such that the asymmetry in one part of the sky is similar to the inverse asymmetry in the corresponding part of the sky in the opposite hemisphere. Fitting the distribution of galaxy spin directions to cosine dependence shows a dipole axis with probability of 4.66$\sigma$. Interestingly, the location of the most likely axis is within close proximity to the CMB Cold Spot. The profile of the distribution is nearly identical to the asymmetry profile of the distribution identified in Pan-STARRS, and it is within 1$\sigma$ difference from the distribution profile in SDSS and HST. All four telescopes show similar large-scale profile of asymmetry.


title: Stability of twisted states on lattices of Kuramoto oscillators

abstract: Real world systems comprised of coupled oscillators have the ability to exhibit spontaneous synchronization and other complex behaviors. The interplay between the underlying network topology and the emergent dynamics remains a rich area of investigation for both theory and experiment. In this work we study lattices of coupled Kuramoto oscillators with non-local interactions. Our focus is on the stability of twisted states. These are equilibrium solutions with constant phase shifts between oscillators resulting in spatially linear profiles. Linear stability analysis follows from studying the quadratic form associated with the Jacobian matrix. Novel estimates on both stable and unstable regimes of twisted states are obtained in several cases. Moreover, exploiting the "almost circulant" nature of the Jacobian obtains a surprisingly accurate numerical test for stability. While our focus is on 2D square lattices, we show how our results can be extended to higher dimensions.


title: Nonequilibrium statistical mechanics for stationary turbulent dispersion

abstract: We propose a unified framework to study the turbulent transport problem from the perspective of nonequilibrium statistical mechanics. By combining Krarichnan's turbulence thermalization assumption and Ruelle's recent work on nonequilibrium statistical mechanics settings for fluids, we show that the equation for viscous fluid can be viewed as the non-canonical Hamiltonian system perturbed by different thermostats. This allows an analogy between the viscous fluid and the nonequilibrium heat conduction model where the Fourier modes can be regarded as the ''particles''. With this framework, we reformulate the dispersion of Lagrangian particles in turbulence as a nonequilibrium transport problem. We also derive the first and the second generalized fluctuation-dissipation relations for the Lagrangian particle using respectively the path-integral technique and the Mori-Zwanzig equation. The obtained theoretical results can be used predict the dispersion of the Lagrangian particle in a general nonequilibrium.

categories: cond-mat.stat-mech math-ph math.MP physics.flu-dyn


title: Time Fisher Information associated with Fluctuations in Quantum Geometry

abstract: As time is not an observable, we use Fisher information (FI) to address the problem of time. We show that the Hamiltonian constraint operator cannot be used to analyze any quantum process for quantum geometries that are associated with time-reparametrization invariant classical geometries. This is because the Hamiltonian constraint does not contain FI about time. We demonstrate that although the Hamiltonian operator is the generator of time, the Hamiltonian constraint operator can not observe the change that arises through the passage of time. This means that the problem of time is inescapably problematic in the associated quantum gravitational theories. Although we explicitly derive these results on the world-sheet of bosonic strings, we argue that it holds in general. We also identify an operator on the world-sheet which contains FI about time in a string theoretical processes. Motivated by this observation, we propose that a criteria for a meaningful operator of any quantum gravitational process, is that it should contain non-vanishing FI about time.


title: Simple estimate of BBN sensitivity to light freeze-in dark matter

abstract: We provide a simple analysis of the big-bang nucleosynthesis (BBN) sensitivity to the light dark matter (DM) generated by the thermal freeze-in mechanism. It is shown that the ratio of the effective neutrino number shift $\Delta N_{\nu}$ over the DM relic density $\omega\equiv \Omega h^2$, denoted by $R_\chi\equiv\Delta N_\nu/\omega$, cancels the decaying particle mass and the feeble coupling, rendering therefore a simple visualization of $\Delta N_{\nu}$ at the BBN epoch in terms of the DM mass. This property drives one to conclude that the shift with a sensitivity of $\Delta N_{\nu}\simeq \mathcal{O}(0.1)$ cannot originate from a single warm DM under the Lyman-$\alpha$ forest constraints. For the cold-plus-warm DM scenarios where the Lyman-$\alpha$ constraints are diluted, the ratio $R_\chi$ can be potentially used to test the thermal freeze-in mechanism in generating a small warm component of DM and a possible excess at the level of $\Delta N_{\nu}\simeq \mathcal{O}(0.01)$.


title: Oscillations in the EMRI gravitational wave phase correction as a probe of reflective boundary of the central black hole

abstract: We discuss the energy loss due to gravitational radiation of binaries composed of exotic objects whose horizon boundary conditions are replaced with reflective ones. Our focus is on the extreme mass-ratio inspirals, in which the central heavier black hole is replaced with an exotic compact object. We show, in this case, a modulation of the energy loss rate depending on the evolving orbital frequency occurs and leads to two different types of modifications to the gravitational wave phase evolution; the oscillating part directly corresponding to the modulation in the energy flux, and the non-oscillating part coming from the quadratic order in the modulation. This modification can be sufficiently large to detect with future space-borne detectors.


title: Self-orthogonal codes over a non-unital ring and combinatorial matrices

abstract: There is a local ring $E$ of order $4,$ without identity for the multiplication, defined by generators and relations as $E=\langle a,b \mid 2a=2b=0,\, a^2=a,\, b^2=b,\,ab=a,\, ba=b\rangle.$ We study a special construction of self-orthogonal codes over $E,$ based on combinatorial matrices related to two-class association schemes, Strongly Regular Graphs (SRG), and Doubly Regular Tournaments (DRT). We construct quasi self-dual codes over $E,$ and Type IV codes, that is, quasi self-dual codes whose all codewords have even Hamming weight. All these codes can be represented as formally self-dual additive codes over $\F_4.$ The classical invariant theory bound for the weight enumerators of this class of codesimproves the known bound on the minimum distance of Type IV codes over $E.$


title: Variational Policy Search using Sparse Gaussian Process Priors for Learning Multimodal Optimal Actions

abstract: Policy search reinforcement learning has been drawing much attention as a method of learning a robot control policy. In particular, policy search using such non-parametric policies as Gaussian process regression can learn optimal actions with high-dimensional and redundant sensors as input. However, previous methods implicitly assume that the optimal action becomes unique for each state. This assumption can severely limit such practical applications as robot manipulations since designing a reward function that appears in only one optimal action for complex tasks is difficult. The previous methods might have caused critical performance deterioration because the typical non-parametric policies cannot capture the optimal actions due to their unimodality. We propose novel approaches in non-parametric policy searches with multiple optimal actions and offer two different algorithms commonly based on a sparse Gaussian process prior and variational Bayesian inference. The following are the key ideas: 1) multimodality for capturing multiple optimal actions and 2) mode-seeking for capturing one optimal action by ignoring the others. First, we propose a multimodal sparse Gaussian process policy search that uses multiple overlapped GPs as a prior. Second, we propose a mode-seeking sparse Gaussian process policy search that uses the student-t distribution for a likelihood function. The effectiveness of those algorithms is demonstrated through applications to object manipulation tasks with multiple optimal actions in simulations.


title: Uniqueness Results on a geometric PDE in Riemannian and CR Geoemetry Revisited

abstract: We revisit some uniqueness results for a geometric nonlinear PDE related to the scalar curvature in Riemannian geometry and CR geometry. In the Riemannian case we give a new proof of the uniqueness result assuming only a positive lower bound for Ricci curvature. We apply the same principle in the CR case and reconstruct the Jerison-Lee identity in a more general setting. As a consequence we prove a stronger uniqueness result in the CR case. We also discuss some open problems for further study.


title: Transition Motion Planning for Multi-Limbed Vertical Climbing Robots Using Complementarity Constraints

abstract: In order to achieve autonomous vertical wall climbing, the transition phase from the ground to the wall requires extra consideration inevitably. This paper focuses on the contact sequence planner to transition between flat terrain and vertical surfaces for multi-limbed climbing robots. To overcome the transition phase, it requires planning both multi-contact and contact wrenches simultaneously which makes it difficult. Instead of using a predetermined contact sequence, we consider various motions on different environment setups via modeling contact constraints and limb switchability as complementarity conditions. Two safety factors for toe sliding and motor over-torque are the main tuning parameters for different contact sequences. By solving as a nonlinear program (NLP), we can generate several feasible sequences of foot placements and contact forces to avoid failure cases. We verified feasibility with demonstrations on the hardware SiLVIA, a six-legged robot capable of vertically climbing between two walls by bracing itself in-between using only friction.


title: Black hole perturbations in DHOST theories: Master variables, gradient instability, and strong coupling

abstract: We study linear perturbations about static and spherically symmetric black hole solutions with stealth scalar hair in degenerate higher-order scalar-tensor (DHOST) theories. We clarify master variables and derive the quadratic Lagrangian for both odd- and even-parity perturbations. It is shown that the even modes are in general plagued by gradient instabilities, or otherwise the perturbations would be strongly coupled. Several possible ways out are also discussed.


title: A Path-Counting Analysis of Phase Shifts in Box-Ball Systems

abstract: In this paper, we perform a detailed analysis of the phase shift phenomenon of the classical soliton cellular automaton known as the box-ball system, ultimately resulting in a statement and proof of a formula describing this phase shift. This phenomenon has been observed since the nineties, when the system was first introduced by Takahashi and Satsuma, but no explicit global description was made beyond its observation. By using the Gessel-Viennot-Lindstr\"om lemma and path-counting arguments, we present here a novel proof of the classical phase shift formula for the continuous-time Toda lattice, as discovered by Moser, and use this proof to derive a discrete-time Toda lattice analogue of the phase shift phenomenon. By carefully analysing the connection between the box-ball system and the discrete-time Toda lattice, through the mechanism of tropicalisation/dequantisation, we translate this discrete-time Toda lattice phase shift formula into our new formula for the box-ball system phase shift.


title: Shortcuts in stochastic systems and control of biophysical processes

abstract: The biochemical reaction networks that regulate living systems are all stochastic to varying degrees. The resulting randomness affects biological outcomes at multiple scales, from the functional states of single proteins in a cell to the evolutionary trajectory of whole populations. Controlling how the distribution of these outcomes changes over time -- via external interventions like time-varying concentrations of chemical species -- is a complex challenge. In this work, we show how counterdiabatic (CD) driving, first developed to control quantum systems, provides a versatile tool for steering biological processes. We develop a practical graph-theoretic framework for CD driving in discrete-state continuous-time Markov networks. Though CD driving is limited to target trajectories that are instantaneous stationary states, we show how to generalize the approach to allow for non-stationary targets and local control -- where only a subset of system states are targeted. The latter is particularly useful for biological implementations where there may be only a small number of available external control knobs, insufficient for global control. We derive simple graphical criteria for when local versus global control is possible. Finally, we illustrate the formalism with global control of a genetic regulatory switch and local control in chaperone-assisted protein folding. The derived control protocols in the chaperone system closely resemble natural control strategies seen in experimental measurements of heat shock response in yeast and E. coli.


title: GPT3-to-plan: Extracting plans from text using GPT-3

abstract: Operations in many essential industries including finance and banking are often characterized by the need to perform repetitive sequential tasks. Despite their criticality to the business, workflows are rarely fully automated or even formally specified, though there may exist a number of natural language documents describing these procedures for the employees of the company. Plan extraction methods provide us with the possibility of extracting structure plans from such natural language descriptions of the plans/workflows, which could then be leveraged by an automated system. In this paper, we investigate the utility of generalized language models in performing such extractions directly from such texts. Such models have already been shown to be quite effective in multiple translation tasks, and our initial results seem to point to their effectiveness also in the context of plan extractions. Particularly, we show that GPT-3 is able to generate plan extraction results that are comparable to many of the current state of the art plan extraction methods.


title: Reactor scale simulations of ALD and ALE: ideal and non-ideal self-limited processes in a cylindrical and a 300 mm wafer cross-flow reactor

abstract: We have developed a simulation tool to model self-limited processes such as atomic layer deposition and atomic layer etching inside reactors of arbitrary geometry. In this work, we have applied this model to two standard types of cross-flow reactors: a cylindrical reactor and a model 300 mm wafer reactor, and explored both ideal and non-ideal self-limited kinetics. For the cylindrical tube reactor the full simulation results agree well with analytic expressions obtained using a simple plug flow model, though the presence of axial diffusion tends to soften growth profiles with respect to the plug flow case. Our simulations also allowed us to model the output of in-situ techniques such as quartz crystal microbalance and mass spectrometry, providing a way of discriminating between ideal and non-ideal surface kinetics using in-situ measurements. We extended the simulations to consider two non-ideal self-limited processes: soft-saturating processes characterized by a slow reaction pathway, and processes where surface byproducts can compete with the precursor for the same pool of adsorption sites, allowing us to quantify their impact in the thickness variability across 300 mm wafer substrates.


title: Extensions of the Kahn--Saks inequality for posets of width two

abstract: The Kahn--Saks inequality is a classical result on the number of linear extensions of finite posets. We give a new proof of this inequality for posets of width two using explicit injections of lattice paths. As a consequence we obtain a $q$-analogue, a multivariate generalization and an equality condition in this case. We also discuss the equality conditions of the Kahn--Saks inequality for general posets and prove several implications between conditions conjectured to be equivalent.


title: Discerning the painter's hand: machine learning on surface topography

abstract: Attribution of paintings is a critical problem in art history. This study extends machine learning analysis to surface topography of painted works. A controlled study of positive attribution was designed with paintings produced by a class of art students. The paintings were scanned using a confocal optical profilometer to produce surface data. The surface data were divided into virtual patches and used to train an ensemble of convolutional neural networks (CNNs) for attribution. Over a range of patch sizes from 0.5 to 60 mm, the resulting attribution was found to be 60 to 96% accurate, and, when comparing regions of different color, was nearly twice as accurate as CNNs using color images of the paintings. Remarkably, short length scales, as small as twice a bristle diameter, were the key to reliably distinguishing among artists. These results show promise for real-world attribution, particularly in the case of workshop practice.


title: MTC: Multiresolution Tensor Completion from Partial and Coarse Observations

abstract: Existing tensor completion formulation mostly relies on partial observations from a single tensor. However, tensors extracted from real-world data are often more complex due to: (i) Partial observation: Only a small subset (e.g., 5%) of tensor elements are available. (ii) Coarse observation: Some tensor modes only present coarse and aggregated patterns (e.g., monthly summary instead of daily reports). In this paper, we are given a subset of the tensor and some aggregated/coarse observations (along one or more modes) and seek to recover the original fine-granular tensor with low-rank factorization. We formulate a coupled tensor completion problem and propose an efficient Multi-resolution Tensor Completion model (MTC) to solve the problem. Our MTC model explores tensor mode properties and leverages the hierarchy of resolutions to recursively initialize an optimization setup, and optimizes on the coupled system using alternating least squares. MTC ensures low computational and space complexity. We evaluate our model on two COVID-19 related spatio-temporal tensors. The experiments show that MTC could provide 65.20% and 75.79% percentage of fitness (PoF) in tensor completion with only 5% fine granular observations, which is 27.96% relative improvement over the best baseline. To evaluate the learned low-rank factors, we also design a tensor prediction task for daily and cumulative disease case predictions, where MTC achieves 50% in PoF and 30% relative improvements over the best baseline.


title: Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery

abstract: This paper reports a CPU-level real-time stereo matching method for surgical images (10 Hz on 640 * 480 image with a single core of i5-9400). The proposed method is built on the fast ''dense inverse searching'' algorithm, which estimates the disparity of the stereo images. The overlapping image patches (arbitrary squared image segment) from the images at different scales are aligned based on the photometric consistency presumption. We propose a Bayesian framework to evaluate the probability of the optimized patch disparity at different scales. Moreover, we introduce a spatial Gaussian mixed probability distribution to address the pixel-wise probability within the patch. In-vivo and synthetic experiments show that our method can handle ambiguities resulted from the textureless surfaces and the photometric inconsistency caused by the Lambertian reflectance. Our Bayesian method correctly balances the probability of the patch for stereo images at different scales. Experiments indicate that the estimated depth has higher accuracy and fewer outliers than the baseline methods in the surgical scenario.


title: Why Can You Lay Off Heads? Investigating How BERT Heads Transfer

abstract: The huge size of the widely used BERT family models has led to recent efforts about model distillation. The main goal of distillation is to create a task-agnostic pre-trained model that can be fine-tuned on downstream tasks without fine-tuning its full-sized version. Despite the progress of distillation, to what degree and for what reason a task-agnostic model can be created from distillation has not been well studied. Also, the mechanisms behind transfer learning of those BERT models are not well investigated either. Therefore, this work focuses on analyzing the acceptable deduction when distillation for guiding the future distillation procedure. Specifically, we first inspect the prunability of the Transformer heads in RoBERTa and ALBERT using their head importance estimation proposed by Michel et al. (2019), and then check the coherence of the important heads between the pre-trained task and downstream tasks. Hence, the acceptable deduction of performance on the pre-trained task when distilling a model can be derived from the results, and we further compare the behavior of the pruned model before and after fine-tuning. Our studies provide guidance for future directions about BERT family model distillation.


title: Self-Supervised Metric Learning in Multi-View Data: A Downstream Task Perspective

abstract: Self-supervised metric learning has been a successful approach for learning a distance from an unlabeled dataset. The resulting distance is broadly useful for improving various distance-based downstream tasks, even when no information from downstream tasks is utilized in the metric learning stage. To gain insights into this approach, we develop a statistical framework to theoretically study how self-supervised metric learning can benefit downstream tasks in the context of multi-view data. Under this framework, we show that the target distance of metric learning satisfies several desired properties for the downstream tasks. On the other hand, our investigation suggests the target distance can be further improved by moderating each direction's weights. In addition, our analysis precisely characterizes the improvement by self-supervised metric learning on four commonly used downstream tasks: sample identification, two-sample testing, $k$-means clustering, and $k$-nearest neighbor classification. When the distance is estimated from an unlabeled dataset, we establish the upper bound on distance estimation's accuracy and the number of samples sufficient for downstream task improvement. Finally, numerical experiments are presented to support the theoretical results in the paper.


title: Pre-Trained Models: Past, Present and Future

abstract: Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI). Owing to sophisticated pre-training objectives and huge model parameters, large-scale PTMs can effectively capture knowledge from massive labeled and unlabeled data. By storing knowledge into huge parameters and fine-tuning on specific tasks, the rich knowledge implicitly encoded in huge parameters can benefit a variety of downstream tasks, which has been extensively demonstrated via experimental verification and empirical analysis. It is now the consensus of the AI community to adopt PTMs as backbone for downstream tasks rather than learning models from scratch. In this paper, we take a deep look into the history of pre-training, especially its special relation with transfer learning and self-supervised learning, to reveal the crucial position of PTMs in the AI development spectrum. Further, we comprehensively review the latest breakthroughs of PTMs. These breakthroughs are driven by the surge of computational power and the increasing availability of data, towards four important directions: designing effective architectures, utilizing rich contexts, improving computational efficiency, and conducting interpretation and theoretical analysis. Finally, we discuss a series of open problems and research directions of PTMs, and hope our view can inspire and advance the future study of PTMs.


title: SinIR: Efficient General Image Manipulation with Single Image Reconstruction

abstract: We propose SinIR, an efficient reconstruction-based framework trained on a single natural image for general image manipulation, including super-resolution, editing, harmonization, paint-to-image, photo-realistic style transfer, and artistic style transfer. We train our model on a single image with cascaded multi-scale learning, where each network at each scale is responsible for image reconstruction. This reconstruction objective greatly reduces the complexity and running time of training, compared to the GAN objective. However, the reconstruction objective also exacerbates the output quality. Therefore, to solve this problem, we further utilize simple random pixel shuffling, which also gives control over manipulation, inspired by the Denoising Autoencoder. With quantitative evaluation, we show that SinIR has competitive performance on various image manipulation tasks. Moreover, with a much simpler training objective (i.e., reconstruction), SinIR is trained 33.5 times faster than SinGAN (for 500 X 500 images) that solves similar tasks. Our code is publicly available at github.com/YooJiHyeong/SinIR.


title: Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attacks

abstract: Although the adoption rate of deep neural networks (DNNs) has tremendously increased in recent years, a solution for their vulnerability against adversarial examples has not yet been found. As a result, substantial research efforts are dedicated to fix this weakness, with many studies typically using a subset of source images to generate adversarial examples, treating every image in this subset as equal. We demonstrate that, in fact, not every source image is equally suited for this kind of assessment. To do so, we devise a large-scale model-to-model transferability scenario for which we meticulously analyze the properties of adversarial examples, generated from every suitable source image in ImageNet by making use of three of the most frequently deployed attacks. In this transferability scenario, which involves seven distinct DNN models, including the recently proposed vision transformers, we reveal that it is possible to have a difference of up to $12.5\%$ in model-to-model transferability success, $1.01$ in average $L_2$ perturbation, and $0.03$ ($8/225$) in average $L_{\infty}$ perturbation when $1,000$ source images are sampled randomly among all suitable candidates. We then take one of the first steps in evaluating the robustness of images used to create adversarial examples, proposing a number of simple but effective methods to identify unsuitable source images, thus making it possible to mitigate extreme cases in experimentation and support high-quality benchmarking.


title: Planarity in Generalized Scattering Amplitudes: PK Polytope, Generalized Root Systems and Worldsheet Associahedra

abstract: In this paper we study the role of planarity in generalized scattering amplitudes, through several closely interacting structures in combinatorics, algebraic and tropical geometry. The generalized biadjoint scalar amplitude, introduced recently by Cachazo-Early-Guevara-Mizera (CEGM), is a rational function of homogeneous degree $-(k-1)(n-k-1)$ in $\binom{n}{k}-n$ independent variables; its poles can be constructed directly from the rays of the positive tropical Grassmannian. We introduce for each pair of integers $(k,n)$ with $2\le k\le n-2$ a system of generalized positive roots which arises as a specialization of the planar basis of kinematic invariants. We prove that the higher root polytope $\mathcal{R}^{(k)}_{n-k}$ has volume the k-dimensional Catalan number $C^{(k)}_{n-k}$, via a flag unimodular triangulation into simplices, in bijection with noncrossing collections of $k$-element subsets. We also give a bijection between certain positroidal subdivisions, called tripods, of the hypersimplex $\Delta_{3,n}$ and noncrossing pairs of 3-element subsets that are not weakly separated. We show that the facets of the Planar Kinematics (PK) polytope, introduced recently by Cachazo and the author, are exactly the $\binom{n}{k}-n$ generalized positive roots. We show that the PK specialization of the generalized biadjoint amplitude evaluates to $C^{(k)}_{n-k}$. Looking forward, we give defining equations and conjecture explicit solutions using $(\mathbb{CP}^{n-k-1})^{\times (k-1)}$ via a notion of compatibility degree for noncrossing collections, for a two parameter family of generalized worldsheet associahedra $\mathcal{W}^+_{k,n}$. These specialize when $k=2$ to a certain dihedrally invariant partial compactification of the configuration space $M_{0,n}$ of $n$ distinct points in $\mathbb{CP}^{1}$. Many detailed examples are given throughout to motivate future work.


title: On Absence of Threshold Resonances for Schrodinger and Dirac Operators

abstract: Using a unified approach employing a homogeneous Lippmann-Schwinger-type equation satisfied by resonance functions and basic facts on Riesz potentials, we discuss the absence of threshold resonances for Dirac and Schrodinger operators with sufficiently short-range interactions in general space dimensions. More specifically, assuming a sufficient power law decay of potentials, we derive the absence of zero-energy resonances for massless Dirac operators in space dimensions $n \geq 3$, the absence of resonances at $\pm m$ for massive Dirac operators (with mass $m > 0$) in dimensions $n \geq 5$, and recall the well-known case of absence of zero-energy resonances for Schr\"odinger operators in dimension $n \geq 5$.


title: Few-shot learning of new sound classes for target sound extraction

abstract: Target sound extraction consists of extracting the sound of a target acoustic event (AE) class from a mixture of AE sounds. It can be realized using a neural network that extracts the target sound conditioned on a 1-hot vector that represents the desired AE class. With this approach, embedding vectors associated with the AE classes are directly optimized for the extraction of sound classes seen during training. However, it is not easy to extend this framework to new AE classes, i.e. unseen during training. Recently, speech, music, or AE sound extraction based on enrollment audio of the desired sound offers the potential of extracting any target sound in a mixture given only a short audio signal of a similar sound. In this work, we propose combining 1-hot- and enrollment-based target sound extraction, allowing optimal performance for seen AE classes and simple extension to new classes. In experiments with synthesized sound mixtures generated with the Freesound Dataset (FSD) datasets, we demonstrate the benefit of the combined framework for both seen and new AE classes. Besides, we also propose adapting the embedding vectors obtained from a few enrollment audio samples (few-shot) to further improve performance on new classes.


title: Interplay between pairing and triaxial shape degrees of freedom in Os and Pt nuclei

abstract: The effect of coupling between pairing and quadrupole triaxial shape vibrations on the low-energy collective states of $\gamma$-soft nuclei is investigated using a model based on the framework of nuclear energy density functionals (EDFs). Employing a constrained self-consistent mean-field (SCMF) method that uses universal EDFs and pairing interactions, potential energy surfaces of characteristic $\gamma$-soft Os and Pt nuclei with $A\approx190$ are calculated as functions of the pairing and triaxial quadrupole deformations. Collective spectroscopic properties are computed using a number-nonconserving interacting boson model (IBM) Hamiltonian, with parameters determined by mapping the SCMF energy surface onto the expectation value of the Hamiltonian in the boson condensate state. It is shown that, by simultaneously considering both the shape and pairing collective degrees of freedom, the EDF-based IBM successfully reproduces data on collective structures based on low-energy $0^{+}$ states, as well as $\gamma$-vibrational bands.


title: Large Deviations Asymptotics of Rectangular Spherical Integral

abstract: In this article we study the Dyson Bessel process, which describes the evolution of singular values of rectangular matrix Brownian motions, and prove a large deviation principle for its empirical particle density. We then use it to obtain the asymptotics of the so-called rectangular spherical integrals as $m,n$ go to infinity while $m/n$ converges.


title: Nonlinear Anderson localization in Toda lattices

abstract: We study the Anderson localization in nonlinear systems by taking a nonlinear transmission line realizing the Toda lattice. It is found that the randomness in inductance induces the Anderson localization in the voltage propagation. Furthermore, the nonlinearity enhances the Anderson localization. They are understood in terms of attractive interactions to form a soliton in a nonlinear system. Our results will be applicable in general to the Anderson localization in nonlinear systems that have solitons.


title: On the Sample Complexity of Learning under Invariance and Geometric Stability

abstract: Many supervised learning problems involve high-dimensional data such as images, text, or graphs. In order to make efficient use of data, it is often useful to leverage certain geometric priors in the problem at hand, such as invariance to translations, permutation subgroups, or stability to small deformations. We study the sample complexity of learning problems where the target function presents such invariance and stability properties, by considering spherical harmonic decompositions of such functions on the sphere. We provide non-parametric rates of convergence for kernel methods, and show improvements in sample complexity by a factor equal to the size of the group when using an invariant kernel over the group, compared to the corresponding non-invariant kernel. These improvements are valid when the sample size is large enough, with an asymptotic behavior that depends on spectral properties of the group. Finally, these gains are extended beyond invariance groups to also cover geometric stability to small deformations, modeled here as subsets (not necessarily subgroups) of permutations.


title: Floquet engineering of topological localization transitions and mobility edges in one-dimensional non-Hermitian quasicrystals

abstract: Time-periodic driving fields could endow a system with peculiar topological and transport features. In this work, we find dynamically controlled localization transitions and mobility edges in non-Hermitian quasicrystals via shaking the lattice periodically. The driving force dresses the hopping amplitudes between lattice sites, yielding alternate transitions between localized, mobility edge and extended non-Hermitian quasicrystalline phases. We apply our Floquet engineering approach to five representative models of non-Hermitian quasicrystals, obtain the conditions of photon-assisted localization transitions and mobility edges, and find the expressions of Lyapunov exponents for some models. We further introduce topological winding numbers of Floquet quasienergies to distinguish non-Hermitian quasicrystalline phases with different localization nature. Our discovery thus extend the study of quasicrystals to non-Hermitian Floquet systems, and provide an efficient way of modulating the topological and transport properties of these unique phases.


title: Selective Listening by Synchronizing Speech with Lips

abstract: A speaker extraction algorithm seeks to extract the speech of a target speaker from a multi-talker speech mixture when given a cue that represents the target speaker, such as a pre-enrolled speech utterance, or an accompanying video track. Visual cues are particularly useful when a pre-enrolled speech is not available. In this work, we don't rely on the target speaker's pre-enrolled speech, but rather use the target speaker's face track as the speaker cue, that is referred to as the auxiliary reference, to form an attractor towards the target speaker. We advocate that the temporal synchronization between the speech and its accompanying lip movements is a direct and dominant audio-visual cue. Therefore, we propose a self-supervised pre-training strategy, to exploit the speech-lip synchronization cue for target speaker extraction, which allows us to leverage abundant unlabeled in-domain data. We transfer the knowledge from the pre-trained model to the attractor encoder of the speaker extraction network. We show that the proposed speaker extraction network outperforms various competitive baselines in terms of signal quality, perceptual quality, and intelligibility, achieving state-of-the-art performance.


title: Thermodynamics and Self-organization of Strongly Coupled Coulomb Clusters: An Experimental Study

abstract: In this experimental work, the thermodynamics and self-organization of classical two-dimensional Coulomb clusters are studied as a function of the cluster size. The experiments are carried out in a DC glow discharge Argon plasma in the Dusty Plasma Experimental (DPEx) device for clusters with different number of particles. Hexagonal symmetry around each individual particle is quantified using the local orientational order parameter ($|{\psi_6}|$) for all the configurations. The screened Coulomb coupling parameter, which plays a key role in determining the thermodynamic nature of a Coulomb cluster, is estimated using Langevin dynamics and found to be sensitive to the number of particles present in the cluster. In addition, the process of self-organization and the dynamics of individual particles of the cluster as it changes from a metastable state to the ground state are examined through the estimation of dynamic entropy. Our findings suggest an intimate link between the configurational ordering and the thermodynamics of a strongly coupled Coulomb cluster system - an insight that might be of practical value in analysing and controlling the micro dynamics of a wider class of finite systems.


title: Fast Construction of 4-Additive Spanners

abstract: A $k$-additive spanner of a graph is a subgraph that preserves the distance between any two nodes up to a total additive error of $+k$. Efficient algorithms have been devised for constructing 2 [Aingworth et al. SIAM '99], 6 [Baswana et al. ACM '10, Woodruff ICALP '13], and 8-additive spanners [Knudsen '17], but no efficient algorithms for 4-additive spanners have yet been discovered. In this paper we present a modification of Chechik's 4-additive spanner construction [Chechik SODA '13] that produces a 4-additive spanner on $\Oish(n^{7/5})$ edges, with an improved runtime of $\Oish(mn^{3/5})$ from $O(mn)$. We also discuss generalizations to the setting of weighted additive spanners.


title: Iterative Methods for Private Synthetic Data: Unifying Framework and New Methods

abstract: We study private synthetic data generation for query release, where the goal is to construct a sanitized version of a sensitive dataset, subject to differential privacy, that approximately preserves the answers to a large collection of statistical queries. We first present an algorithmic framework that unifies a long line of iterative algorithms in the literature. Under this framework, we propose two new methods. The first method, private entropy projection (PEP), can be viewed as an advanced variant of MWEM that adaptively reuses past query measurements to boost accuracy. Our second method, generative networks with the exponential mechanism (GEM), circumvents computational bottlenecks in algorithms such as MWEM and PEP by optimizing over generative models parameterized by neural networks, which capture a rich family of distributions while enabling fast gradient-based optimization. We demonstrate that PEP and GEM empirically outperform existing algorithms. Furthermore, we show that GEM nicely incorporates prior information from public data while overcoming limitations of PMW^Pub, the existing state-of-the-art method that also leverages public data.


title: Local time stepping for the shallow water equations in MPAS

abstract: We assess the performance of a set of local time-stepping (LTS) schemes for the shallow water equations implemented in the Model for Prediction Across Scales (MPAS). The goal of LTS is to speed up the simulation by allowing different time-steps on different regions of the computational grid. The LTS schemes considered here were originally introduced by Hoang et al. (J. Comput. Phys., Vol. 382, p.152-176, 2019), who laid out the mathematical foundation of the methods. Here, the authors take on the task of presenting a fast, efficient and scalable parallel implementation of these LTS methods on high performance computing machines, with the aim to provide a recipe for other climate modeling groups that may be interested in employing LTS algorithms in their codes. As a matter of fact, even if MPAS is our framework of choice, our approach is general enough and could be of interest to other groups beyond the MPAS community. Due to their nature, LTS methods possess an inherent load imbalance that needs to be carefully addressed in order to obtain efficient scalability. Even more important is the far from trivial task of computing the right-hand side terms only on specific LTS regions during the time-stepping procedure. An inefficient handling of this task causes a drastic decay of the CPU time performance, making the LTS algorithms practically of no use. The emphasis of the present work is therefore on the computational and parallel aspects of the LTS methods, whose proper handling is crucial to make the methods run faster against existing strategies, such as for instance high-order explicit global time-stepping schemes. This is in fact the ultimate goal of using an LTS procedure and it is the one to which we direct all our optimization efforts.


title: CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning

abstract: Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep) learning models and bandwidth-constrained connections. In this paper, we introduce a communication-efficient algorithmic framework called CFedAvg for FL with non-i.i.d. datasets, which works with general (biased or unbiased) SNR-constrained compressors. We analyze the convergence rate of CFedAvg for non-convex functions with constant and decaying learning rates. The CFedAvg algorithm can achieve an $\mathcal{O}(1 / \sqrt{mKT} + 1 / T)$ convergence rate with a constant learning rate, implying a linear speedup for convergence as the number of workers increases, where $K$ is the number of local steps, $T$ is the number of total communication rounds, and $m$ is the total worker number. This matches the convergence rate of distributed/federated learning without compression, thus achieving high communication efficiency while not sacrificing learning accuracy in FL. Furthermore, we extend CFedAvg to cases with heterogeneous local steps, which allows different workers to perform a different number of local steps to better adapt to their own circumstances. The interesting observation in general is that the noise/variance introduced by compressors does not affect the overall convergence rate order for non-i.i.d. FL. We verify the effectiveness of our CFedAvg algorithm on three datasets with two gradient compression schemes of different compression ratios.


title: Temporal Predictive Coding For Model-Based Planning In Latent Space

abstract: High-dimensional observations are a major challenge in the application of model-based reinforcement learning (MBRL) to real-world environments. To handle high-dimensional sensory inputs, existing approaches use representation learning to map high-dimensional observations into a lower-dimensional latent space that is more amenable to dynamics estimation and planning. In this work, we present an information-theoretic approach that employs temporal predictive coding to encode elements in the environment that can be predicted across time. Since this approach focuses on encoding temporally-predictable information, we implicitly prioritize the encoding of task-relevant components over nuisance information within the environment that are provably task-irrelevant. By learning this representation in conjunction with a recurrent state space model, we can then perform planning in latent space. We evaluate our model on a challenging modification of standard DMControl tasks where the background is replaced with natural videos that contain complex but irrelevant information to the planning task. Our experiments show that our model is superior to existing methods in the challenging complex-background setting while remaining competitive with current state-of-the-art models in the standard setting.


title: Multiple scattering ambisonics: three-dimensional sound field estimation using interacting spheres

abstract: Rigid spherical microphone arrays (RSMAs) have been widely used in ambisonics sound field recording. While it is desired to combine the information captured by a grid of densely arranged RSMAs for expanding the area of accurate reconstruction, or sweet-spots, this is not trivial due to inter-array interference. Here we propose multiple scattering ambisonics, a method for three-dimensional ambisonics sound field recording using multiple acoustically interacting RSMAs. Numerical experiments demonstrate the sweet-spot expansion realized by the proposed method. The proposed method can be used with existing RSMAs as building blocks and opens possibilities including higher degrees-of-freedom spatial audio.


title: A Novel Variable K-Pseudonym Scheme Applied to 5G Anonymous Access Authentication

abstract: Anonymous access authentication schemes provide users with massive application services while protecting the privacy of users' identities. The identity protection schemes in 3G and 4G are not suitable for 5G anonymous access authentication due to complex computation and pseudonym asynchrony. In this paper, we consider mobile devices with limited resources in the 5G network and propose an anonymous access authentication scheme without the Public Key Infrastructure. The anonymous access authentication scheme provides users with variable shard pseudonyms to protect users' identities asynchronously. With the variable shared pseudonym, our scheme can ensure user anonymity and resist the mark attack, a novel attack aimed at the basic k-pseudonym scheme. Finally, we analyze the scheme with BAN logic analysis and verify the user anonymity.


title: Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images

abstract: Instance segmentation is of great importance for many biological applications, such as study of neural cell interactions, plant phenotyping, and quantitatively measuring how cells react to drug treatment. In this paper, we propose a novel box-based instance segmentation method. Box-based instance segmentation methods capture objects via bounding boxes and then perform individual segmentation within each bounding box region. However, existing methods can hardly differentiate the target from its neighboring objects within the same bounding box region due to their similar textures and low-contrast boundaries. To deal with this problem, in this paper, we propose an object-guided instance segmentation method. Our method first detects the center points of the objects, from which the bounding box parameters are then predicted. To perform segmentation, an object-guided coarse-to-fine segmentation branch is built along with the detection branch. The segmentation branch reuses the object features as guidance to separate target object from the neighboring ones within the same bounding box region. To further improve the segmentation quality, we design an auxiliary feature refinement module that densely samples and refines point-wise features in the boundary regions. Experimental results on three biological image datasets demonstrate the advantages of our method. The code will be available at https://github.com/yijingru/ObjGuided-Instance-Segmentation.


title: Learning Intrusion Prevention Policies through Optimal Stopping

abstract: We study automated intrusion prevention using reinforcement learning. In a novel approach, we formulate the problem of intrusion prevention as an optimal stopping problem. This formulation allows us insight into the structure of the optimal policies, which turn out to be threshold based. Since the computation of the optimal defender policy using dynamic programming is not feasible for practical cases, we approximate the optimal policy through reinforcement learning in a simulation environment. To define the dynamics of the simulation, we emulate the target infrastructure and collect measurements. Our evaluations show that the learned policies are close to optimal and that they indeed can be expressed using thresholds.


title: Heterogeneous Edge-Enhanced Graph Attention Network For Multi-Agent Trajectory Prediction

abstract: Simultaneous trajectory prediction for multiple heterogeneous traffic participants is essential for the safe and efficient operation of connected automated vehicles under complex driving situations in the real world. The multi-agent prediction task is challenging, as the motions of traffic participants are affected by many factors, including their individual dynamics, their interactions with surrounding agents, the traffic infrastructures, and the number and modalities of the target agents. To further advance the trajectory prediction techniques, in this work we propose a three-channel framework together with a novel Heterogeneous Edge-enhanced graph ATtention network (HEAT), which is able to deal with the heterogeneity of the target agents and traffic participants involved. Specifically, the agent's dynamics are extracted from their historical states using type-specific encoders. The inter-agent interactions are represented with a directed edge-featured heterogeneous graph, and then interaction features are extracted using the proposed HEAT network. Besides, the map features are shared across all agents by introducing a selective gate mechanism. And finally, the trajectories of multi-agent are executed simultaneously. Validations using both urban and highway driving datasets show that the proposed model can realize simultaneous trajectory predictions for multiple agents under complex traffic situations, and achieve state-of-the-art performance with respect to prediction accuracy, demonstrating its feasibility and effectiveness.


title: Goal-Aware Neural SAT Solver

abstract: Modern neural networks obtain information about the problem and calculate the output solely from the input values. We argue that it is not always optimal, and the network's performance can be significantly improved by augmenting it with a query mechanism that allows the network at run time to make several solution trials and get feedback on the loss value on each trial. To demonstrate the capabilities of the query mechanism, we formulate an unsupervised (not depending on labels) loss function for Boolean Satisfiability Problem (SAT) and theoretically show that it allows the network to extract rich information about the problem. We then propose a neural SAT solver with a query mechanism called QuerySAT and show that it outperforms the neural baseline on a wide range of SAT tasks.


title: State-dependent Riccati equation feedback stabilization for nonlinear PDEs

abstract: The synthesis of suboptimal feedback laws for controlling nonlinear dynamics arising from semi-discretized PDEs is studied. An approach based on the State-dependent Riccati Equation (SDRE) is presented for H2 and Hinf control problems. Depending on the nonlinearity and the dimension of the resulting problem, offline, online, and hybrid offline-online alternatives to the SDRE synthesis are proposed. The hybrid offline-online SDRE method reduces to the sequential solution of Lyapunov equations, effectively enabling the computation of suboptimal feedback controls for two-dimensional PDEs. Numerical tests for the Sine-Gordon, degenerate Zeldovich, and viscous Burgers' PDEs are presented, providing a thorough experimental assessment of the proposed methodology.


title: Soft hydraulics: from Newtonian to complex fluid flows through compliant conduits

abstract: Microfluidic devices manufactured from soft polymeric materials have emerged as a paradigm for cheap, disposable and easy-to-prototype fluidic platforms for integrating chemical and biological assays and analyses. The interplay between the flow forces and the inherently compliant conduits of such microfluidic devices requires careful consideration. While mechanical compliance was initially a side-effect of the manufacturing process and materials used, compliance has now become a paradigm, enabling new approaches to microrheological measurements, new modalities of micromixing, and improved sieving of micro- and nano-particles, to name a few applications. This topical review provides an introduction to the physics of these systems. Specifically, the goal of this review is to summarize the recent progress towards a mechanistic understanding of the interaction between non-Newtonian (complex) fluid flows and their deformable confining boundaries. In this context, key experimental results and relevant applications are also explored, hand-in-hand with the fundamental principles for their physics-based modeling. The key topics covered include shear-dependent viscosity of non-Newtonian fluids, hydrodynamic pressure gradients during flow, the elastic response (deformation and bulging) of soft conduits due to flow within, the effect of cross-sectional conduit geometry on the resulting fluid--structure interaction, and key dimensionless groups describing the coupled physics. Open problems and future directions in this nascent field of soft hydraulics, at the intersection of non-Newtonian fluid mechanics, soft matter physics, and microfluidics, are noted.


title: Self-training Guided Adversarial Domain Adaptation For Thermal Imagery

abstract: Deep models trained on large-scale RGB image datasets have shown tremendous success. It is important to apply such deep models to real-world problems. However, these models suffer from a performance bottleneck under illumination changes. Thermal IR cameras are more robust against such changes, and thus can be very useful for the real-world problems. In order to investigate efficacy of combining feature-rich visible spectrum and thermal image modalities, we propose an unsupervised domain adaptation method which does not require RGB-to-thermal image pairs. We employ large-scale RGB dataset MS-COCO as source domain and thermal dataset FLIR ADAS as target domain to demonstrate results of our method. Although adversarial domain adaptation methods aim to align the distributions of source and target domains, simply aligning the distributions cannot guarantee perfect generalization to the target domain. To this end, we propose a self-training guided adversarial domain adaptation method to promote generalization capabilities of adversarial domain adaptation methods. To perform self-training, pseudo labels are assigned to the samples on the target thermal domain to learn more generalized representations for the target domain. Extensive experimental analyses show that our proposed method achieves better results than the state-of-the-art adversarial domain adaptation methods. The code and models are publicly available.


title: 2rd Place Solutions in the HC-STVG track of Person in Context Challenge 2021

abstract: In this technical report, we present our solution to localize a spatio-temporal person in an untrimmed video based on a sentence. We achieve the second vIOU(0.30025) in the HC-STVG track of the 3rd Person in Context(PIC) Challenge. Our solution contains three parts: 1) human attributes information is extracted from the sentence, it is helpful to filter out tube proposals in the testing phase and supervise our classifier to learn appearance information in the training phase. 2) we detect humans with YoloV5 and track humans based on the DeepSort framework but replace the original ReID network with FastReID. 3) a visual transformer is used to extract cross-modal representations for localizing a spatio-temporal tube of the target person.


title: End-to-end Neural Diarization: From Transformer to Conformer

abstract: We propose a new end-to-end neural diarization (EEND) system that is based on Conformer, a recently proposed neural architecture that combines convolutional mappings and Transformer to model both local and global dependencies in speech. We first show that data augmentation and convolutional subsampling layers enhance the original self-attentive EEND in the Transformer-based EEND, and then Conformer gives an additional gain over the Transformer-based EEND. However, we notice that the Conformer-based EEND does not generalize as well from simulated to real conversation data as the Transformer-based model. This leads us to quantify the mismatch between simulated data and real speaker behavior in terms of temporal statistics reflecting turn-taking between speakers, and investigate its correlation with diarization error. By mixing simulated and real data in EEND training, we mitigate the mismatch further, with Conformer-based EEND achieving 24% error reduction over the baseline SA-EEND system, and 10% improvement over the best augmented Transformer-based system, on two-speaker CALLHOME data.


title: Systematic Perturbations of the Thermodynamic Properties in Cool Cores of HIFLUGCS Galaxy Clusters

abstract: We present an ensemble X-ray analysis of systematic perturbations in the central hot gas properties for a sample of 28 nearby strong cool-core systems selected from the HIghest X-ray FLUx Galaxy Cluster Sample (HIFLUGCS). We analyze their cool-core features observed with the Chandra X-ray Observatory. All individual systems in our sample exhibit at least a pair of positive and negative excess perturbations in the X-ray residual image after subtracting the global brightness profile. We extract and analyze X-ray spectra of the intracluster medium (ICM) in the detected perturbed regions. To investigate possible origins of the gas perturbations, we characterize thermodynamic properties of the ICM in the perturbed regions and characterize their correlations between positive and negative excess regions. The best-fit relations for temperature and entropy show a clear offset from the one-to-one relation, $T_\mathrm{neg}/T_\mathrm{pos}=1.20^{+0.04}_{-0.03}$ and $K_\mathrm{neg}/K_\mathrm{pos}=1.43\pm 0.07$, whereas the best-fit relation for pressure is found to be remarkably consistent with the one-to-one relation $P_\mathrm{neg}=P_\mathrm{pos}$, indicating that the ICM in the perturbed regions is in pressure equilibrium. These observed features in the HIFLUGCS sample are in agreement with the hypothesis that the gas perturbations in cool cores are generated by gas sloshing. We also analyze synthetic observations of perturbed cluster cores created from binary merger simulations, finding that the observed temperature ratio agrees with the simulations, $T_\mathrm{neg}/T_\mathrm{pos}\sim 1.3$. We conclude that gas sloshing induced by infalling substructures plays a major role in producing the characteristic gas perturbations in cool cores. The ubiquitous presence of gas perturbations in cool cores may suggest a significant contribution of gas sloshing to suppressing runaway cooling of the ICM.


title: Multi-wavelength view of the close-by GRB 190829A sheds light on gamma-ray burst physics

abstract: Gamma-ray bursts are produced as a result of cataclysmic events such as the collapse of a massive star or the merger of two neutron stars. We monitored the position of the close-by gamma-ray burst GRB~190829A, which originated from a massive star collapse, through very long baseline interferometry (VLBI) observations with the EVN and the VLBA, involving a total of 30 telescopes across 4 continents. We carried out a total of 9 observations between 9 and 117 days after the gamma-ray burst at 5 and 15 GHz, with a typical resolution of few milliarcseconds (mas). We obtained limits on the source size and expansion rate. The limits are in agreement with the size evolution entailed by a detailed modelling of the multi-wavelength light curves with a forward plus reverse shock model, which agrees with the observations across almost 18 orders of magnitude in frequency (including the High Energy Stereoscopic System data at TeV photon energies) and more than 4 orders of magnitude in time. Thanks to the broad, high-cadence coverage of the afterglow, afterglow degeneracies are broken to a large extent, allowing us to capture some unique physical insights: we find a low prompt emission efficiency $\lesssim 10^{-3}$; we constrain the fraction of electrons that are accelerated to relativistic speeds in the forward shock to be $\chi_e<13\%$ at the 90\% credible level; we find that the magnetic field energy density in the reverse shock downstream must decay rapidly after the shock crossing. While our model assumes an on-axis jet, our VLBI astrometric measurements alone are not sufficiently tight as to exclude any off-axis viewing angle. On the other hand, we can firmly exclude the line of sight to have been more than $2\,\mathrm{deg}$ away from the border of the region that produced the prompt gamma-ray emission based on compactness arguments.


title: Cohomology with supports; idempotent pairs

abstract: This chapter sets out preliminaries for the duality theory in later chapters. An underlying idea is that local cohomology functors are higher derived functors of colocalizations (a.k.a.~coreflections). Predominantly well-known facts about cohomology with supports--often under "finitary" conditions that obtain, e.g., under noetherian hypotheses--and its local and global interactions with quasi-coherence and with colimits, are reviewed from both the topological and scheme-theoretic perspectives. Some refinements of standard results are needed to accommodate certain features involving unbounded complexes and general systems of supports. An important attribute of such cohomology is "tensor-coreflectiveness," in its avatar--ultimately in the context of closed categories--as "idempotent pair," a notion which plays an important role in the sequel. Some basic facts about linearly topologized noetherian rings and their maps, related to cohomology with supports, and subsumed under properties of idempotent pairs, are brought forth; and similarly for the less-familiar context of formal schemes.


title: Examining and Combating Spurious Features under Distribution Shift

abstract: A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models latching on to spurious correlations between the training input/output pairs that are not fundamental to the problem at hand. In this paper, we define and analyze robust and spurious representations using the information-theoretic concept of minimal sufficient statistics. We prove that even when there is only bias of the input distribution (i.e. covariate shift), models can still pick up spurious features from their training data. Group distributionally robust optimization (DRO) provides an effective tool to alleviate covariate shift by minimizing the worst-case training loss over a set of pre-defined groups. Inspired by our analysis, we demonstrate that group DRO can fail when groups do not directly account for various spurious correlations that occur in the data. To address this, we further propose to minimize the worst-case losses over a more flexible set of distributions that are defined on the joint distribution of groups and instances, instead of treating each group as a whole at optimization time. Through extensive experiments on one image and two language tasks, we show that our model is significantly more robust than comparable baselines under various partitions. Our code is available at https://github.com/violet-zct/group-conditional-DRO.


title: Energy-efficient Knowledge Distillation for Spiking Neural Networks

abstract: Spiking neural networks (SNNs) have been gaining interest as energy-efficient alternatives of conventional artificial neural networks (ANNs) due to their event-driven computation. Considering the future deployment of SNN models to constrained neuromorphic devices, many studies have applied techniques originally used for ANN model compression, such as network quantization, pruning, and knowledge distillation, to SNNs. Among them, existing works on knowledge distillation reported accuracy improvements of student SNN model. However, analysis on energy efficiency, which is also an important feature of SNN, was absent. In this paper, we thoroughly analyze the performance of the distilled SNN model in terms of accuracy and energy efficiency. In the process, we observe a substantial increase in the number of spikes, leading to energy inefficiency, when using the conventional knowledge distillation methods. Based on this analysis, to achieve energy efficiency, we propose a novel knowledge distillation method with heterogeneous temperature parameters. We evaluate our method on two different datasets and show that the resulting SNN student satisfies both accuracy improvement and reduction of the number of spikes. On MNIST dataset, our proposed student SNN achieves up to 0.09% higher accuracy and produces 65% less spikes compared to the student SNN trained with conventional knowledge distillation method. We also compare the results with other SNN compression techniques and training methods.


title: Superconformal duality-invariant models and $\mathcal{N} = 4$ SYM effective action

abstract: We present $\mathcal{N}=2$ superconformal $\mathsf{U}(1)$ duality-invariant models for an Abelian vector multiplet coupled to conformal supergravity. In a Minkowski background, such a nonlinear theory is expected to describe (the planar part of) the low-energy effective action for the $\mathcal{N}=4$ $\mathsf{SU}(N)$ super-Yang-Mills (SYM) theory on its Coulomb branch where (i) the gauge group $\mathsf{SU}(N)$ is spontaneously broken to $\mathsf{SU}(N-1) \times \mathsf{U}(1)$; and (ii) the dynamics is captured by a single $\mathcal{N}=2$ vector multiplet associated with the $\mathsf{U}(1)$ factor of the unbroken group. Additionally, a local $\mathsf{U}(1)$ duality-invariant action generating the $\mathcal{N}=2$ super-Weyl anomaly is proposed. By providing a new derivation of the recently constructed $\mathsf{U}(1)$ duality-invariant $\mathcal{N}=1$ superconformal electrodynamics, we introduce its $\mathsf{SL}(2,{\mathbb R})$ duality-invariant coupling to the dilaton-axion multiplet.


title: A Mutual Information Maximization Approach for the Spurious Solution Problem in Weakly Supervised Question Answering

abstract: Weakly supervised question answering usually has only the final answers as supervision signals while the correct solutions to derive the answers are not provided. This setting gives rise to the spurious solution problem: there may exist many spurious solutions that coincidentally derive the correct answer, but training on such solutions can hurt model performance (e.g., producing wrong solutions or answers). For example, for discrete reasoning tasks as on DROP, there may exist many equations to derive a numeric answer, and typically only one of them is correct. Previous learning methods mostly filter out spurious solutions with heuristics or using model confidence, but do not explicitly exploit the semantic correlations between a question and its solution. In this paper, to alleviate the spurious solution problem, we propose to explicitly exploit such semantic correlations by maximizing the mutual information between question-answer pairs and predicted solutions. Extensive experiments on four question answering datasets show that our method significantly outperforms previous learning methods in terms of task performance and is more effective in training models to produce correct solutions.


title: Learning to Combine Per-Example Solutions for Neural Program Synthesis

abstract: The goal of program synthesis from examples is to find a computer program that is consistent with a given set of input-output examples. Most learning-based approaches try to find a program that satisfies all examples at once. Our work, by contrast, considers an approach that breaks the problem into two stages: (a) find programs that satisfy only one example, and (b) leverage these per-example solutions to yield a program that satisfies all examples. We introduce the Cross Aggregator neural network module based on a multi-head attention mechanism that learns to combine the cues present in these per-example solutions to synthesize a global solution. Evaluation across programs of different lengths and under two different experimental settings reveal that when given the same time budget, our technique significantly improves the success rate over PCCoder [Zohar et. al 2018] and other ablation baselines. The code, data and trained models for our work can be found at https://github.com/shrivastavadisha/N-PEPS.


title: SAS: Self-Augmentation Strategy for Language Model Pre-training

abstract: The core of self-supervised learning for pre-training language models includes pre-training task design as well as appropriate data augmentation. Most data augmentations in language model pre-training are context-independent. A seminal contextualized augmentation was recently proposed in ELECTRA and achieved state-of-the-art performance by introducing an auxiliary generation network (generator) to produce contextualized data augmentation for the training of a main discrimination network (discriminator). This design, however, introduces extra computation cost of the generator and a need to adjust the relative capability between the generator and the discriminator. In this paper, we propose a self-augmentation strategy (SAS) where a single network is utilized for both regular pre-training and contextualized data augmentation for the training in later epochs. Essentially, this strategy eliminates a separate generator and uses the single network to jointly conduct two pre-training tasks with MLM (Masked Language Modeling) and RTD (Replaced Token Detection) heads. It avoids the challenge to search for an appropriate size of the generator, which is critical to the performance as evidenced in ELECTRA and its subsequent variant models. In addition, SAS is a general strategy that can be seamlessly combined with many new techniques emerging recently or in the future, such as the disentangled attention mechanism from DeBERTa. Our experiments show that SAS is able to outperform ELECTRA and other state-of-the-art models in the GLUE tasks with similar or less computation cost.


title: A Two-Step Framework for Arbitrage-Free Prediction of the Implied Volatility Surface

abstract: We propose a two-step framework for predicting the implied volatility surface over time without static arbitrage. In the first step, we select features to represent the surface and predict them over time. In the second step, we use the predicted features to construct the implied volatility surface using a deep neural network (DNN) model by incorporating constraints that prevent static arbitrage. We consider three methods to extract features from the implied volatility data: principal component analysis, variational autoencoder and sampling the surface, and we predict these features using LSTM. Using a long time series of implied volatility data for S\&P500 index options to train our models, we find two feature construction methods, sampling the surface and variational autoencoders combined with DNN for surface construction, are the best performers in out-of-sample prediction. In particular, they outperform a classical method substantially. Furthermore, the DNN model for surface construction not only removes static arbitrage, but also significantly reduces the prediction error compared with a standard interpolation method. Our framework can also be used to simulate the dynamics of the implied volatility surface without static arbitrage.


title: A Comprehensive Survey on Graph Anomaly Detection with Deep Learning

abstract: Anomalies represent rare observations (e.g., data records or events) that deviate significantly from others. Over several decades, research on anomaly mining has received increasing interests due to the implications of these occurrences in a wide range of disciplines. Anomaly detection, which aims to identify rare observations, is among the most vital tasks in the world, and has shown its power in preventing detrimental events, such as financial fraud, network intrusion, and social spam. The detection task is typically solved by identifying outlying data points in the feature space and inherently overlooks the relational information in real-world data. Graphs have been prevalently used to represent the structural information, which raises the graph anomaly detection problem - identifying anomalous graph objects (i.e., nodes, edges and sub-graphs) in a single graph, or anomalous graphs in a database/set of graphs. However, conventional anomaly detection techniques cannot tackle this problem well because of the complexity of graph data. For the advent of deep learning, graph anomaly detection with deep learning has received a growing attention recently. In this survey, we aim to provide a systematic and comprehensive review of the contemporary deep learning techniques for graph anomaly detection. We compile open-sourced implementations, public datasets, and commonly-used evaluation metrics to provide affluent resources for future studies. More importantly, we highlight twelve extensive future research directions according to our survey results covering unsolved and emerging research problems and real-world applications. With this survey, our goal is to create a "one-stop-shop" that provides a unified understanding of the problem categories and existing approaches, publicly available hands-on resources, and high-impact open challenges for graph anomaly detection using deep learning.


title: Remnant Black Hole Kicks and Implications for Hierarchical Mergers

abstract: When binary black holes merge in dense star clusters, their remnants can pair up with other black holes in the cluster, forming heavier and heavier black holes in a process called hierarchical merger. The most important condition for hierarchical merger to occur is that remnants formed by mergers are retained by the host star cluster. Using the publicly available gravitational-wave event database, we infer the magnitudes of kick velocities imparted to the remnant black holes due to anisotropic emission of gravitational waves and use that to quantify the retention probability of each event as a function of the escape speed of the star cluster. Among the second gravitational-wave transient catalog (GWTC-2) events, GW190814 provides the tightest constraint on the kick magnitude with ${\rm V_{kick}}=74_{-7}^{+10}$ km/s at the 90% credible level. We find that star clusters with escape speeds of 200 km/s can retain about 50% of the events in the GWTC-2. Using the escape speed distributions of nuclear star clusters and globular clusters, we find that $\sim 17$ (2) remnants of GWTC-2 may be retained by the host star cluster if all GWTC-2 events occurred in nuclear (globular) clusters. Our study demonstrates the importance of folding in kick velocity inferences in future studies of hierarchical mergers.


title: Mode-sensitive magnetoelastic coupling in phononic-crystal magnomechanics

abstract: Acoustically driven spin-wave resonance in a phononic crystal cavity is numerically investigated. The designed cavity enables confinement of gigahertz vibrations in a wavelength-scale point-defect structure and sustains a variety of resonance modes. Inhomogeneous strain distributions in the modes modify the magnetostrictive coupling and the spin-wave excitation susceptible to an external field orientation. In particular, a monopole-like mode in the cavity having a near-symmetrical pattern shows a subwavelength-scale mode volume and can provide a versatile acoustic excitation scheme independent on field-angle variation. Thus, the phononic-crystal platform offers an alternative approach to acoustically control the spin-wave dynamics with ultrasmall and inhomogeneous mode structures, which will be a key technology to integrate and operate large-scale magnomechanical circuits.


title: Induced spontaneous symmetry breaking chain

abstract: The article discusses a scenario based on the idea of induced spontaneous symmetry breaking. In this type of scenario, spontaneous symmetry breaking is assumed at some highest energy level, which leads to a chain of several subsequent induced symmetry violations at lower levels caused by small mixtures between levels. We present a simple model in which the idea is realized by small mixing between levels using scalar portals. In this approach, the large difference between energy scales, for example the Planck scale and the electroweak scale, occurs due to the product of several small factors proportional to the mixing coefficients. Dark matter fields can be formed in this scenario from matter fields on one or possibly several intermediate levels between the highest and lowest.


title: Deploying COTS Legged Robot Platforms into a Heterogeneous Robot Team

abstract: The recent availability of commercial-off-the-shelf (COTS) legged robot platforms have opened up new opportunities in deploying legged systems into different scenarios. While the main advantage of legged robots is their ability to traverse unstructured terrain, there are still large gaps between what robot platforms can achieve and their animal counterparts. Therefore, when deploying as part of a heterogeneous robot team of different platforms, it is beneficial to understand the different scenarios where a legged platform would perform better than a wheeled, tracked or aerial platform. Two COTS quadruped robots, Ghost Robotics' Vision 60 and Boston Dynamics' Spot, were deployed into a heterogeneous team. A description of some of the challenges faced while integrating the platforms, as well as some experiments in traversing different terrains are provided to give insight into the real-world deployment of legged robots.


title: Single inertial particle statistics in turbulent flows from Lagrangian velocity models

abstract: We present the extension of a modeling technique for Lagrangian tracer particles [B. Viggiano et al., J. Fluid Mech.(2020), vol. 900, A27] which accounts for the effects of particle inertia. Thereby, the particle velocity for several Stokes numbers is modeled directly by a multi-layered Ornstein-Uhlenbeck process and a comparison of key statistical quantities (second-order velocity structure function, acceleration correlation function, and root mean square acceleration) to expressions derived from Batchelor's model as well as to direct numerical simulations (DNS) is performed. In both approaches, Stokes' drag is treated by an approximate ``linear filter'' which replaces the particle position entering the fluid velocity field by the corresponding ideal tracer position. Effects of preferential concentration of inertial particles are taken into account in terms of an effective Stokes number that is determined from the zero crossing of the acceleration correlation function from DNS. This approximation thus allows the modeling of inertial particle statistics through stochastic methods and models for the Lagrangian velocity; the particle velocity is effectively decoupled from the particle position. In contrast to the ordinary filtering technique [Cencini et al., J. Turbul. (2006), 7, N36], our method captures the effects of preferential concentration of particles at low Stokes numbers which manifest themselves for instance by a sharp decrease of the acceleration variance for increasing Stokes numbers.


title: Singular Schr\"odinger operators with prescribed spectral properties

abstract: The paper deals with singular Schr\"odinger operators of the form \begin{gather*} -{\mathrm{d}^2\over \mathrm{d} x^2 } + \sum_{k\in\mathbb{Z} }\gamma_k \delta(\cdot-z_k),\quad \gamma_k\in\mathbb{R}, \end{gather*} in $\mathsf{L}^2(\ell_-,\ell_+)$, where $(\ell_-,\ell_+)$ is a bounded interval, and $ \delta(\cdot-z_k)$ is the Dirac delta-function supported at $z_k\in (\ell_-,\ell_+)$. It will be shown that the interaction strengths $\gamma_k$ and the points $z_k$ can be chosen in such a way that the essential spectrum and a bounded part of the discrete spectrum of this self-adjoint operator coincide with prescribed sets on a real line.


title: Modeling Object Recognition in Newborn Chicks using Deep Neural Networks

abstract: In recent years, the brain and cognitive sciences have made great strides developing a mechanistic understanding of object recognition in mature brains. Despite this progress, fundamental questions remain about the origins and computational foundations of object recognition. What learning algorithms underlie object recognition in newborn brains? Since newborn animals learn largely through unsupervised learning, we explored whether unsupervised learning algorithms can be used to predict the view-invariant object recognition behavior of newborn chicks. Specifically, we used feature representations derived from unsupervised deep neural networks (DNNs) as inputs to cognitive models of categorization. We show that features derived from unsupervised DNNs make competitive predictions about chick behavior compared to supervised features. More generally, we argue that linking controlled-rearing studies to image-computable DNN models opens new experimental avenues for studying the origins and computational basis of object recognition in newborn animals.


title: Sejong Face Database: A Multi-Modal Disguise Face Database

abstract: Commercial application of facial recognition demands robustness to a variety of challenges such as illumination, occlusion, spoofing, disguise, etc. Disguised face recognition is one of the emerging issues for access control systems, such as security checkpoints at the borders. However, the lack of availability of face databases with a variety of disguise addons limits the development of academic research in the area. In this paper, we present a multimodal disguised face dataset to facilitate the disguised face recognition research. The presented database contains 8 facial add-ons and 7 additional combinations of these add-ons to create a variety of disguised face images. Each facial image is captured in visible, visible plus infrared, infrared, and thermal spectra. Specifically, the database contains 100 subjects divided into subset-A (30 subjects, 1 image per modality) and subset-B (70 subjects, 5 plus images per modality). We also present baseline face detection results performed on the proposed database to provide reference results and compare the performance in different modalities. Qualitative and quantitative analysis is performed to evaluate the challenging nature of disguise addons. The dataset will be publicly available with the acceptance of the research article. The database is available at: https://github.com/usmancheema89/SejongFaceDatabase.


title: Multimode Trapped Interferometer with Ideal Bose-Einstein Condensates

abstract: We experimentally demonstrate a multi-mode interferometer comprising a Bose-Einstein condensate of $^{39}$K atoms trapped in a harmonic potential, where the interatomic interaction can be cancelled exploiting Feshbach resonances. Kapitza-Dirac diffraction from an optical lattice coherently splits the BEC in multiple momentum components equally spaced that form different interferometric paths, closed by the trapping harmonic potential. We investigate two different interferometric schemes, where the recombination pulse is applied after a full or half oscillation in the confining potential. We find that the relative amplitudes of the momentum components at the interferometer output are sensitive to external forces, through the induced displacement of the harmonic potential with respect to the optical lattice. We show how to calibrate the interferometer, fully characterize its output and discuss perspective improvements.


title: On exact estimates of the order of approximation of functions of several variables in the anisotropic Lorentz-Zygmund space

abstract: In this paper we consider $L_{\overline{p}, \overline\alpha, \overline{\tau}}^{*}(\mathbb{T}^{m})$ anisotropic Lorentz-Zyg\-mu\-nd space $ 2\pi$ of periodic functions of $m$ variables and Nikol'skii--Besov's class $S_{\overline{p}, \overline\alpha, \overline{\tau}, \bar{\theta}}^{\bar r}B$. In this paper, we establish order-sharp estimates of the best approximation by trigonometric polynomials with harmonic numbers from the step hyperbolic cross of functions from the Nikol'skii - Besov class in the norm of the anisotropic Lorentz-Zygmund space.


title: Capacity of Gaussian Arbitrarily-Varying Fading Channels

abstract: This paper considers an arbitrarily-varying fading channel consisting of one transmitter, one receiver and an arbitrarily varying adversary. The channel is assumed to have additive Gaussian noise and fast fading of the gain from the legitimate user to the receiver. We study four variants of the problem depending on whether the transmitter and/or adversary have access to the fading gains; we assume the receiver always knows the fading gains. In two variants the adversary does not have access to the gains, we show that the capacity corresponds to the capacity of a standard point-to-point fading channel with increased noise variance. The capacity of the other two cases, in which the adversary has knowledge of the channel gains, are determined by the worst-case noise variance as a function of the channel gain subject to the jammer's power constraint; if the jammer has enough power, then it can imitate the legitimate user's channel, causing the capacity to drop to zero. We also show that having the channel gains causally or non-causally at the encoder and/or the adversary does not change the capacity, except for the case where all parties know the channel gains. In this case, if the transmitter knows the gains non-causally, while the adversary knows the gains causally, then it is possible for the legitimate users to keep a secret from the adversary. We show that in this case the capacity is always positive.