title: Commutativity of quantization with conic reduction for torus actions on compact CR manifolds

abstract: We define conic reduction $X^{\mathrm{red}}_{\nu}$ for torus actions on the boundary $X$ of a strictly pseudo-convex domain and for a given weight $\nu$ labeling a unitary irreducible representation. There is a natural residual circle action on $X^{\mathrm{red}}_{\nu}$. We have two natural decompositions of the corresponding Hardy spaces $H(X)$ and $H(X^{\mathrm{red}}_{\nu})$. The first one is given by the ladder of isotypes $H(X)_{k\nu}$, $k\in\mathbb{Z}$, the second one is given by the $k$-th Fourier components $H(X^{\mathrm{red}}_{\nu})_k$ induced by the residual circle action. The aim of this paper is to prove that they are isomorphic for $k$ sufficiently large. The result is given for spaces of $(0,q)$-forms with $L^2$-coefficient when $X$ is a CR manifold with non-degenerate Levi-curvature.


title: Integrated Path Planning and Tracking Control of Marine Current Turbine in Uncertain Ocean Environments

abstract: This paper presents an integrated path planning and tracking control of marine hydrokinetic energy harvesting devices. To address the highly nonlinear and uncertain oceanic environment, the path planner is designed based on a reinforcement learning (RL) approach by fully exploring the historical ocean current profiles. The planner will search for a path to optimize a chosen cost criterion, such as maximizing the total harvested energy for a given time. Model predictive control (MPC) is then utilized to design the tracking control for the optimal path command from the planner subject to problem constraints. The planner and the tracking control are accommodated in an integrated framework to optimize these two parts in a real-time manner. The proposed approach is validated on a marine current turbine (MCT) that executes vertical waypoint path searching to maximize the net power due to spatiotemporal uncertainties in the ocean environment, as well as the path following via an MPC tracking controller to navigate the MCT to the optimal path. Results demonstrate that the path planning increases harnessed power compared to the baseline (i.e., maintaining MCT at an equilibrium depth), and the tracking controller can successfully follow the reference path under different shear profiles.


title: A Robotic Antenna Alignment and Tracking System for Millimeter Wave Propagation Modeling

abstract: In this paper, we discuss the design of a sliding-correlator channel sounder for 28 GHz propagation modeling on the NSF POWDER testbed in Salt Lake City, UT. Beam-alignment is mechanically achieved via a fully autonomous robotic antenna tracking platform, designed using commercial off-the-shelf components. Equipped with an Apache Zookeeper/Kafka managed fault-tolerant publish-subscribe framework, we demonstrate tracking response times of 27.8 ms, in addition to superior scalability over state-of-the-art mechanical beam-steering systems. Enhanced with real-time kinematic correction streams, our geo-positioning subsystem achieves a 3D accuracy of 17 cm, while our principal axes positioning subsystem achieves an average accuracy of 1.1 degrees across yaw and pitch movements. Finally, by facilitating remote orchestration (via managed containers), uninhibited rotation (via encapsulation), and real-time positioning visualization (via Dash/MapBox), we exhibit a proven prototype well-suited for V2X measurements.


title: On Downlink Interference Decoding In Multi-Cell Massive MIMO Systems

abstract: In this paper, the downlink of a multi-cell massive MIMO system is considered where the channel state information (CSI) is estimated via pilot symbols that are orthogonal in a cell but re-used in other cells. Re-using the pilots, however, contaminates the CSI estimate at each base station (BS) by the channel of the users sharing the same pilot in other cells. The resulting inter-cell interference does not vanish even when the number of BS antennas $M$ is large, i.e., $M\rightarrow\infty$, and thus the rates achieved by treating interference as noise (TIN) saturate even if $M\rightarrow\infty$. In this paper, interference aware decoding schemes based on simultaneous unique decoding (SD) and simultaneous non-unique decoding (SND) of the full interference or a part of the interference (PD) are studied with two different linear precoding techniques: maximum ratio transmission (MRT) and zero forcing (ZF). The resulting rates are shown to grow unbounded as $M\rightarrow\infty$. In addition, the rates achievable via SD/SND/PD for finite $M$ are derived using a worst-case uncorrelated noise technique, which are shown to scale as $\mathcal{O}(\log M)$. To compare the performance of different schemes, the maximum symmetric rate problem is studied, where it is confirmed that with large, yet practical, values of $M$, SND strictly outperforms TIN, and also that PD strictly outperforms SND.


title: Data driven analysis of thermal simulations, microstructure and mechanical properties of Inconel 718 thin walls deposited by metal additive manufacturing

abstract: The extreme and repeated temperature variation during additive manufacturing of metal parts has a large effect on the resulting material microstructure and properties. The ability to accurately predict this temperature field in detail, and relate it quantitatively to structure and properties, is a key step in predicting part performance and optimizing process design. In this work, a finite element simulation of the Directed Energy Deposition (DED) process is used to predict the space- and time-dependent temperature field during the multi-layer build process for Inconel 718 walls. The thermal model is validated using the dynamic infrared (IR) images captured in situ during the DED builds, showing good agreement with experimental measurements. The relationship between predicted cooling rate, microstructural features, and mechanical properties is examined, and cooling rate alone is found to be insufficient in giving quantitative property predictions. Because machine learning offers an efficient way to identify important features from series data, we apply a 1D convolutional neural network (CNN) data-driven framework to automatically extract the dominant predictive features from simulated temperature history. The relationship between the CNN-extracted features and the mechanical properties is studied. To interpret how CNN performs in intermediate layers, we visualize the extracted features produced on each convolutional layer by a trained CNN. Our results show that the results predicted by the CNN agree well with experimental measurements and give insights into physical mechanisms of microstructure evolution and mechanical properties.


title: Terwilliger algebras and some related algebras defined by finite connected simple graphs

abstract: For a finite connected simple graph, the Terwilliger algebra is a matrix algebra generated by the adjacency matrix and idempotents corresponding to the distance partition with respect to a fixed vertex. We will consider algebras defined by two other partitions and the centralizer algebra of the stabilizer of the fixed vertex in the automorphism group of the graph. We will give some methods to compute such algebras and examples for various graphs.


title: Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast

abstract: Though image-level weakly supervised semantic segmentation (WSSS) has achieved great progress with Class Activation Maps (CAMs) as the cornerstone, the large supervision gap between classification and segmentation still hampers the model to generate more complete and precise pseudo masks for segmentation. In this study, we propose weakly-supervised pixel-to-prototype contrast that can provide pixel-level supervisory signals to narrow the gap. Guided by two intuitive priors, our method is executed across different views and within per single view of an image, aiming to impose cross-view feature semantic consistency regularization and facilitate intra(inter)-class compactness(dispersion) of the feature space. Our method can be seamlessly incorporated into existing WSSS models without any changes to the base networks and does not incur any extra inference burden. Extensive experiments manifest that our method consistently improves two strong baselines by large margins, demonstrating the effectiveness. Specifically, built on top of SEAM, we improve the initial seed mIoU on PASCAL VOC 2012 from 55.4% to 61.5%. Moreover, armed with our method, we increase the segmentation mIoU of EPS from 70.8% to 73.6%, achieving new state-of-the-art.


title: A Novel Traffic Simulation Framework for Testing Autonomous Vehicles Using SUMO and CARLA

abstract: Traffic simulation is an efficient and cost-effective way to test Autonomous Vehicles (AVs) in a complex and dynamic environment. Numerous studies have been conducted for AV evaluation using traffic simulation over the past decades. However, the current simulation environments fall behind on two fronts -- the background vehicles (BVs) fail to simulate naturalistic driving behavior and the existing environments do not test the entire pipeline in a modular fashion. This study aims to propose a simulation framework that creates a complex and naturalistic traffic environment. Specifically, we combine a modified version of the Simulation of Urban MObility (SUMO) simulator with the Cars Learning to Act (CARLA) simulator to generate a simulation environment that could emulate the complexities of the external environment while providing realistic sensor outputs to the AV pipeline. In a past research work, we created an open-source Python package called SUMO-Gym which generates a realistic road network and naturalistic traffic through SUMO and combines that with OpenAI Gym to provide ease of use for the end user. We propose to extend our developed software by adding CARLA, which in turn will enrich the perception of the ego vehicle by providing realistic sensors outputs of the AVs surrounding environment. Using the proposed framework, AVs perception, planning, and control could be tested in a complex and realistic driving environment. The performance of the proposed framework in constructing output generation and AV evaluations are demonstrated using several case studies.


title: On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structure

abstract: We study the problem of control policy design for decentralized state-feedback linear quadratic control with a partially nested information structure, when the system model is unknown. We propose a model-based learning solution, which consists of two steps. First, we estimate the unknown system model from a single system trajectory of finite length, using least squares estimation. Next, based on the estimated system model, we design a control policy that satisfies the desired information structure. We show that the suboptimality gap between our control policy and the optimal decentralized control policy (designed using accurate knowledge of the system model) scales linearly with the estimation error of the system model. Using this result, we provide an end-to-end sample complexity result for learning decentralized controllers for a linear quadratic control problem with a partially nested information structure.


title: A note on the relation between the Contextual Fraction and CNT2

abstract: Contextuality (or lack thereof) is a property of systems of random variables. Among the measures of the degree of contextuality, two have played important roles. One of them, Contextual Fraction ($\text{CNTF}$) was proposed within the framework of the sheaf-theoretic approach to contextuality, and extended to arbitrary systems in the Contextuality-by-Default approach. The other, denoted $\text{CNT}_{2}$, was proposed as one of the measures within the Contextuality-by-Default approach. In this note, I prove that $\text{CNTF}=2\text{CNT}_{2}$ within a class of systems, called cyclic, that have played a prominent role in contextuality research.


title: Comparison of the Characteristics of Magnetars Born in Death of Massive Stars and Merger of Compact Objects With {\em Swift} Gamma-Ray Burst Data

abstract: Assuming that the shallow-decaying phase in the early X-ray lightcurves of gamma-ray bursts (GRBs) is attributed to the dipole radiations (DRs) of a newborn magnetar, we present a comparative analysis for the magnetars born in death of massive stars and merger of compact binaries with long and short GRB (lGRB and sGRB) data observed with the {\em Swift} mission. We show that the typical braking index ($n$) of the magnetars is $\sim 3$ in the sGRB sample, and it is $\sim 4$ for the magnetars in the lGRB sample. Selecting a sub-sample of the magnetars whose spin-down is dominated by DRs ($n\lesssim 3$) and adopting a universal radiation efficiency of $0.3$, we find that the typical magnetic field strength ($B_p$) is $10^{16}$ G {\em vs.} $10^{15}$ G and the typical initial period ($P_0$) is $\sim 20$ ms {\em vs.} $2$ ms for the magnetars in the sGRBs {\em vs.} lGRBs. They follow the same relation between $P_0$ and the isotropic GRB energy as $ P_0\propto E_{\rm jet}^{-0.4}$. We also extend our comparison analysis to superluminous supernovae (SLSNe) and stable pulsars. Our results show that a magnetar born in merger of compact stars tends to have a stronger $B_p$ and a longer $P_0$ by about one order of magnitude than that born in collapse of massive stars. Its spin-down is dominated by the magnetic DRs as old pulsars, being due to its strong magnetic field strength, whereas the early spin-down of magnetars born in massive star collapse is governed by both the DRs and gravitational wave (GW) emission. A magnetar with a faster rotation speed should power a more energetic jet, being independent of its formation approach.


title: Answer to a question by A. Mandarino, T. Linowski and K. \.{Z}yczkowski

abstract: A recent work by A. Mandarino, T. Linowski and K. \.{Z}yczkowski left open the following question. If $ \mu_N $ is a certain permutation of entries of a $ N^2 \times N^2 $ matrix ("mixing map") and $ U_N $ is a $ N^2 \times N^2 $ Haar unitary random matrix, then is the family $ U_N, U_N^{\mu_N}, ( U_N^2 )^{\mu_N}, \dots , ( U_N^m)^{\mu_N} $ asymptotically free? (here by $A^{ \mu}$ we understand the matrix resulted by permuting the entries of $ A $ according to the permutation $ \mu $). This paper presents some techniques for approaching such problems. In particular, one easy consequence of the main result is that the question above has an affirmative answer.


title: Auxiliary Loss of Transformer with Residual Connection for End-to-End Speaker Diarization

abstract: End-to-end neural diarization (EEND) with self-attention directly predicts speaker labels from inputs and enables the handling of overlapped speech. Although the EEND outperforms clustering-based speaker diarization (SD), it cannot be further improved by simply increasing the number of encoder blocks because the last encoder block is dominantly supervised compared with lower blocks. This paper proposes a new residual auxiliary EEND (RX-EEND) learning architecture for transformers to enforce the lower encoder blocks to learn more accurately. The auxiliary loss is applied to the output of each encoder block, including the last encoder block. The effect of auxiliary loss on the learning of the encoder blocks can be further increased by adding a residual connection between the encoder blocks of the EEND. Performance evaluation and ablation study reveal that the auxiliary loss in the proposed RX-EEND provides relative reductions in the diarization error rate (DER) by 50.3% and 21.0% on the simulated and CALLHOME (CH) datasets, respectively, compared with self-attentive EEND (SA-EEND). Furthermore, the residual connection used in RX-EEND further relatively reduces the DER by 8.1% for CH dataset.


title: FAIR Data Pipeline: provenance-driven data management for traceable scientific workflows

abstract: Modern epidemiological analyses to understand and combat the spread of disease depend critically on access to, and use of, data. Rapidly evolving data, such as data streams changing during a disease outbreak, are particularly challenging. Data management is further complicated by data being imprecisely identified when used. Public trust in policy decisions resulting from such analyses is easily damaged and is often low, with cynicism arising where claims of "following the science" are made without accompanying evidence. Tracing the provenance of such decisions back through open software to primary data would clarify this evidence, enhancing the transparency of the decision-making process. Here, we demonstrate a Findable, Accessible, Interoperable and Reusable (FAIR) data pipeline developed during the COVID-19 pandemic that allows easy annotation of data as they are consumed by analyses, while tracing the provenance of scientific outputs back through the analytical source code to data sources. Such a tool provides a mechanism for the public, and fellow scientists, to better assess the trust that should be placed in scientific evidence, while allowing scientists to support policy-makers in openly justifying their decisions. We believe that tools such as this should be promoted for use across all areas of policy-facing research.


title: Nuisance-Label Supervision: Robustness Improvement by Free Labels

abstract: In this paper, we present a Nuisance-label Supervision (NLS) module, which can make models more robust to nuisance factor variations. Nuisance factors are those irrelevant to a task, and an ideal model should be invariant to them. For example, an activity recognition model should perform consistently regardless of the change of clothes and background. But our experiments show existing models are far from this capability. So we explicitly supervise a model with nuisance labels to make extracted features less dependent on nuisance factors. Although the values of nuisance factors are rarely annotated, we demonstrate that besides existing annotations, nuisance labels can be acquired freely from data augmentation and synthetic data. Experiments show consistent improvement in robustness towards image corruption and appearance change in action recognition.


title: Measuring lens dimensionality in extreme scattering events through wave optics

abstract: Compact radio sources have been observed to undergo large, frequency dependent changes in intensity due to lensing by structures in the interstellar medium, in so-called "extreme scattering events" (ESEs). While the study of astrophysical plasma lensing has primarily focused on the geometric limit of optics, coherent radio sources such as pulsars exhibit wave effects when lensed. The additional phase information provided by interference effects in the wave regime may yield more information about the lens than could be obtained in the geometric regime. In this paper, we show that, using wave effects, one can potentially distinguish a one-dimensional lens (where "one-dimensional" includes both highly elongated lenses, as well as perfectly axisymmetric lenses) from a fully two-dimensional lens, with minimal assumptions on the form of the lensing potential.


title: Making Corgis Important for Honeycomb Classification: Adversarial Attacks on Concept-based Explainability Tools

abstract: Methods for model explainability have become increasingly critical for testing the fairness and soundness of deep learning. Concept-based interpretability techniques, which use a small set of human-interpretable concept exemplars in order to measure the influence of a concept on a model's internal representation of input, are an important thread in this line of research. In this work we show that these explainability methods can suffer the same vulnerability to adversarial attacks as the models they are meant to analyze. We demonstrate this phenomenon on two well-known concept-based interpretability methods: TCAV and faceted feature visualization. We show that by carefully perturbing the examples of the concept that is being investigated, we can radically change the output of the interpretability method. The attacks that we propose can either induce positive interpretations (polka dots are an important concept for a model when classifying zebras) or negative interpretations (stripes are not an important factor in identifying images of a zebra). Our work highlights the fact that in safety-critical applications, there is need for security around not only the machine learning pipeline but also the model interpretation process.


title: Secure Precoding in MIMO-NOMA: A Deep Learning Approach

abstract: A novel signaling design for secure transmission over two-user multiple-input multiple-output non-orthogonal multiple access channel using deep neural networks (DNNs) is proposed. The goal of the DNN is to form the covariance matrix of users' signals such that the message of each user is transmitted reliably while being confidential from its counterpart. The proposed DNN linearly precodes each user's signal before superimposing them and achieves near-optimal performance with significantly lower run time. Simulation results show that the proposed models reach about 98% of the secrecy capacity rates. The spectral efficiency of the DNN precoder is much higher than that of existing analytical linear precoders--e.g., generalized singular value decomposition--and its on-the-fly complexity is several times less than the existing iterative methods.


abstract: Recommender systems may be confounded by various types of confounding factors (also called confounders) that may lead to inaccurate recommendations and sacrificed recommendation performance. Current approaches to solving the problem usually design each specific model for each specific confounder. However, real-world systems may include a huge number of confounders and thus designing each specific model for each specific confounder could be unrealistic. More importantly, except for those ``explicit confounders'' that experts can manually identify and process such as item's position in the ranking list, there are also many ``latent confounders'' that are beyond the imagination of experts. For example, users' rating on a song may depend on their current mood or the current weather, and users' preference on ice creams may depend on the air temperature. Such latent confounders may be unobservable in the recorded training data. To solve the problem, we propose Deconfounded Causal Collaborative Filtering (DCCF). We first frame user behaviors with unobserved confounders into a causal graph, and then we design a front-door adjustment model carefully fused with machine learning to deconfound the influence of unobserved confounders. Experiments on real-world datasets show that our method is able to deconfound unobserved confounders to achieve better recommendation performance.


title: Casimir effect with one large extra dimension

abstract: In this work I study the Casimir effect of a massive complex scalar field in the presence of one large compactified extra dimension. I investigate the case of a scalar field confined between two parallel plates in the macroscopic three dimensions, and examine the cases of Dirichlet and mixed (Dirichlet-Neumann) boundary conditions on the plates. The case of Neumann boundary conditions is uninteresting, since it yields the same result as the case of Dirichlet boundary conditions. The scalar field also permeates a fourth compactified dimension of a size that could be comparable to the distance between the plates. This investigation is carried out using the $\zeta$-function regularization technique that allows me to obtain exact expressions for the Casimir energy and pressure. I discover that, when the compactified length of the extra dimension is similar to the plate distance, or slightly larger, the Casimir energy and pressure become significantly different than their standard three dimensional values, for either Dirichlet or mixed boundary conditions. Therefore, the Casimir effect of a quantum field that permeates a compactified fourth dimension, could be used as an effective tool to explore the existence of large compactified extra dimensions.


title: Multi-ACCDOA: Localizing and Detecting Overlapping Sounds from the Same Class with Auxiliary Duplicating Permutation Invariant Training

abstract: Sound event localization and detection (SELD) involves identifying the direction-of-arrival (DOA) and the event class. The SELD methods with a class-wise output format make the model predict activities of all sound event classes and corresponding locations. The class-wise methods can output activity-coupled Cartesian DOA (ACCDOA) vectors, which enable us to solve a SELD task with a single target using a single network. However, there is still a challenge in detecting the same event class from multiple locations. To overcome this problem while maintaining the advantages of the class-wise format, we extended ACCDOA to a multi one and proposed auxiliary duplicating permutation invariant training (ADPIT). The multi- ACCDOA format (a class- and track-wise output format) enables the model to solve the cases with overlaps from the same class. The class-wise ADPIT scheme enables each track of the multi-ACCDOA format to learn with the same target as the single-ACCDOA format. In evaluations with the DCASE 2021 Task 3 dataset, the model trained with the multi-ACCDOA format and with the class-wise ADPIT detects overlapping events from the same class while maintaining its performance in the other cases. Also, the proposed method performed comparably to state-of-the-art SELD methods with fewer parameters.


title: General solutions of poroelastic equations with viscous stress

abstract: Mechanical properties of cellular structures, including the cell cytoskeleton, are increasingly used as biomarkers for disease diagnosis and fundamental studies in cell biology. Recent experiments suggest that the cell cytoskeleton and its permeating cytosol, can be described as a poroelastic (PE) material. Biot theory is the standard model used to describe PE materials. Yet, this theory does not account for the fluid viscous stress, which can lead to inaccurate predictions of the mechanics in the dilute filamentous network of the cytoskeleton. Here, we adopt a two-phase model that extends Biot theory by including the fluid viscous stresses in the fluid's momentum equation. We use generalized linear viscoelastic (VE) constitutive equations to describe the permeating fluid and the network stresses and assume a constant friction coefficient that couples the fluid and network displacement fields. As the first step in developing a computational framework for solving the resulting equations, we derive closed-form general solutions of the fluid and network displacement fields in spherical coordinates. To demonstrate the applicability of our results, we study the motion of a rigid sphere moving under a constant force inside a PE medium, composed of a linear elastic network and a Newtonian fluid. We find that the network compressibility introduces a slow relaxation of the sphere and a non-monotonic network displacements with time along the direction of the applied force. These novel features cannot be predicted if VE constitutive equation is used for the medium. We show that our results can be applied to particle-tracking microrheology to differentiate between PE and VE materials and to independently measure the permeability and VE properties of the fluid and the network phases.


title: Root Finding With Interval Arithmetic

abstract: We consider the solution of nonlinear equations in one real variable, the problem usually called by root finding. Although this is an old problem, we believe that some aspects of its solution using interval arithmetic are not well understood, and we present our views on this subject. We argue that problems with just one variable are much simpler than problems with more variables, and we should use specific methods for them. We provide an implementation of our ideas in C++, and make this code available under the Mozilla Public License 2.0.


title: Monitoring the Mental State of Cooperativeness for Guiding an Elderly Person in Sit-to-Stand Assistance

abstract: In providing physical assistance to elderly people, ensuring cooperative behavior from the elderly persons is a critical requirement. In sit-to-stand assistance, for example, an older adult must lean forward, so that the body mass can shift towards the feet before a caregiver starts lifting the body. An experienced caregiver guides the older adult through verbal communications and physical interactions, so that the older adult may be cooperative throughout the process. This guidance is of paramount importance and is a major challenge in introducing a robotic aid to the eldercare environment. The wide-scope goal of the current work is to develop an intelligent eldercare robot that can a) monitor the mental state of an older adult, and b) guide the older adult through an assisting procedure so that he/she can be cooperative in being assisted. The current work presents a basic modeling framework for describing a human's physical behaviors reflecting an internal mental state, and an algorithm for estimating the mental state through interactive observations. The sit-to-stand assistance problem is considered for the initial study. A simple Kalman Filter is constructed for estimating the level of cooperativeness in response to applied cues, with a thresholding scheme being used to make judgments on the cooperativeness state.


title: WebAssembly enables low latency interoperable augmented and virtual reality software

abstract: There is a clear difference in runtime performance between native applications that use augmented/virtual reality (AR/VR) device-specific hardware and comparable web-based implementations. Here we show that WebAssembly (Wasm) offers a promising developer solution that can bring near-native low latency performance to web-based applications, enabling hardware-agnostic interoperability at scale through portable bytecode that runs on any WiFi or cellular data network-enabled AR/VR device. Many software application areas have begun to realize Wasm's potential as a key enabling technology, but it has yet to establish a robust presence in the AR/VR domain. When considering the limitations of current web-based AR/VR development technologies such as WebXR, which provides an existing application programming interface (API) that enables AR/VR capabilities for web-based programs, Wasm can resolve critical issues faced with just-in-time (JIT) compilation, slow run-times, large file sizes and big data, among other challenges. Existing applications using Wasm-based WebXR are sparse but growing, and the potential for porting native applications to use this emerging framework will benefit the web-based AR/VR application space and bring it closer to its native counterparts in terms of performance. Taken together, this kind of standardized "write-once-deploy-everywhere" software framework for AR/VR applications has the potential to consolidate user experiences across different head-mounted displays and other compatible hardware devices to ultimately create an interoperable AR/VR ecosystem.


title: A Hong-Krahn-Szeg\"{o} inequality for mixed local and nonlocal operators

abstract: Given a bounded open set $\Omega\subseteq{\mathbb{R}}^n$, we consider the eigenvalue problem of a nonlinear mixed local/nonlocal operator with vanishing conditions in the complement of $\Omega$. We prove that the second eigenvalue $\lambda_2(\Omega)$ is always strictly larger than the first eigenvalue $\lambda_1(B)$ of a ball $B$ with volume half of that of $\Omega$. This bound is proven to be sharp, by comparing to the limit case in which $\Omega$ consists of two equal balls far from each other. More precisely, differently from the local case, an optimal shape for the second eigenvalue problem does not exist, but a minimizing sequence is given by the union of two disjoint balls of half volume whose mutual distance tends to infinity.


title: Region Semantically Aligned Network for Zero-Shot Learning

abstract: Zero-shot learning (ZSL) aims to recognize unseen classes based on the knowledge of seen classes. Previous methods focused on learning direct embeddings from global features to the semantic space in hope of knowledge transfer from seen classes to unseen classes. However, an unseen class shares local visual features with a set of seen classes and leveraging global visual features makes the knowledge transfer ineffective. To tackle this problem, we propose a Region Semantically Aligned Network (RSAN), which maps local features of unseen classes to their semantic attributes. Instead of using global features which are obtained by an average pooling layer after an image encoder, we directly utilize the output of the image encoder which maintains local information of the image. Concretely, we obtain each attribute from a specific region of the output and exploit these attributes for recognition. As a result, the knowledge of seen classes can be successfully transferred to unseen classes in a region-bases manner. In addition, we regularize the image encoder through attribute regression with a semantic knowledge to extract robust and attribute-related visual features. Experiments on several standard ZSL datasets reveal the benefit of the proposed RSAN method, outperforming state-of-the-art methods.


title: Reverse Maximum Inner Product Search: How to efficiently find users who would like to buy my item?

abstract: The MIPS (maximum inner product search), which finds the item with the highest inner product with a given query user, is an essential problem in the recommendation field. It is usual that e-commerce companies face situations where they want to promote and sell new or discounted items. In these situations, we have to consider a question: who are interested in the items and how to find them? This paper answers this question by addressing a new problem called reverse maximum inner product search (reverse MIPS). Given a query vector and two sets of vectors (user vectors and item vectors), the problem of reverse MIPS finds a set of user vectors whose inner product with the query vector is the maximum among the query and item vectors. Although the importance of this problem is clear, its straightforward implementation incurs a computationally expensive cost. We therefore propose Simpfer, a simple, fast, and exact algorithm for reverse MIPS. In an offline phase, Simpfer builds a simple index that maintains a lower-bound of the maximum inner product. By exploiting this index, Simpfer judges whether the query vector can have the maximum inner product or not, for a given user vector, in a constant time. Besides, our index enables filtering user vectors, which cannot have the maximum inner product with the query vector, in a batch. We theoretically demonstrate that Simpfer outperforms baselines employing state-of-the-art MIPS techniques. Furthermore, our extensive experiments on real datasets show that Simpfer is at least two orders magnitude faster than the baselines.


title: Spectral representation of neutrino propagator in media and off-shell spin properties

abstract: We construct a spectral representation of neutrino propagator in matter moving with constant velocity, or in constant homogenious magnetic field. In both cases there exists definite 4-axis $z$ of complete polarization, such that corresponding spin projectos commute with propagator. As a result, all eigenvalues of propagator and dispersion laws are classified accoding to spin projection on this axis.


title: On well-edge-dominated graphs

abstract: A graph is said to be well-edge-dominated if all its minimal edge dominating sets are minimum. It is known that every well-edge-dominated graph $G$ is also equimatchable, meaning that every maximal matching in $G$ is maximum. In this paper, we show that if $G$ is a connected, triangle-free, nonbipartite, well-edge-dominated graph, then $G$ is one of three graphs. We also characterize the well-edge-dominated split graphs and Cartesian products. In particular, we show that a connected Cartesian product $G\Box H$ is well-edge-dominated, where $G$ and $H$ have order at least $2$, if and only if $G\Box H = K_2 \Box K_2$.


title: A fractional glance to the theory of edge dislocations

abstract: We revisit some recents results inspired by the Peierls-Nabarro model on edge dislocations for crystals which rely on the fractional Laplace representation of the corresponding equation. In particular, we discuss results related to heteroclinic, homoclinic and multibump patterns for the atom dislocation function, the large space and time scale of the solutions of the parabolic problem, the dynamics of the dislocation points and the large time asymptotics after possible dislocation collisions.


title: A variant of the $\Lambda(p)$ set problem in Orlicz spaces

abstract: We introduce $ \Lambda(\Phi) $-sets as generalizations of $ \Lambda(p) $-sets. These sets are defined in terms of Orlicz norms. We consider $\Lambda(\Phi)$-sets when the Matuszewska-Orlicz index of $ \Phi $ is larger than $ 2 $. When $S$ is a $\Lambda(\Phi)$-set, we establish an estimate of the size of $ S \cap [-N,N] $ where $ N \in \mathbb{N} $. Next, we construct a $ \Lambda(\Phi_1)$-set which is not a $ \Lambda(\Phi_2)$-set for any $ \Phi_2 $ such that $ \sup_{u \geq 1} \Phi_2(u) / \Phi_1(u) = \infty $ by using a probabilistic method. With an additional assumption about a subset $E$ of $\mathbb{Z}$, we can construct such a $\Lambda(\Phi_1)$-set contained in $E$. These statements extend known results on the structure of $ \Lambda(p) $-sets to $\Lambda(\Phi)$-sets.


title: Federated Learning for COVID-19 Detection with Generative Adversarial Networks in Edge Cloud Computing

abstract: COVID-19 has spread rapidly across the globe and become a deadly pandemic. Recently, many artificial intelligence-based approaches have been used for COVID-19 detection, but they often require public data sharing with cloud datacentres and thus remain privacy concerns. This paper proposes a new federated learning scheme, called FedGAN, to generate realistic COVID-19 images for facilitating privacy-enhanced COVID-19 detection with generative adversarial networks (GANs) in edge cloud computing. Particularly, we first propose a GAN where a discriminator and a generator based on convolutional neural networks (CNNs) at each edge-based medical institution alternatively are trained to mimic the real COVID-19 data distribution. Then, we propose a new federated learning solution which allows local GANs to collaborate and exchange learned parameters with a cloud server, aiming to enrich the global GAN model for generating realistic COVID-19 images without the need for sharing actual data. To enhance the privacy in federated COVID-19 data analytics, we integrate a differential privacy solution at each hospital institution. Moreover, we propose a new blockchain-based FedGAN framework for secure COVID-19 data analytics, by decentralizing the FL process with a new mining solution for low running latency. Simulations results demonstrate the superiority of our approach for COVID-19 detection over the state-of-the-art schemes.


title: A CLIP-Enhanced Method for Video-Language Understanding

abstract: This technical report summarizes our method for the Video-And-Language Understanding Evaluation (VALUE) challenge (https://value-benchmark.github.io/challenge\_2021.html). We propose a CLIP-Enhanced method to incorporate the image-text pretrained knowledge into downstream video-text tasks. Combined with several other improved designs, our method outperforms the state-of-the-art by $2.4\%$ ($57.58$ to $60.00$) Meta-Ave score on VALUE benchmark.


title: ETF Risk Models

abstract: We discuss how to build ETF risk models. Our approach anchors on i) first building a multilevel (non-)binary classification/taxonomy for ETFs, which is utilized in order to define the risk factors, and ii) then building the risk models based on these risk factors by utilizing the heterotic risk model construction of https://ssrn.com/abstract=2600798 (for binary classifications) or general risk model construction of https://ssrn.com/abstract=2722093 (for non-binary classifications). We discuss how to build an ETF taxonomy using ETF constituent data. A multilevel ETF taxonomy can also be constructed by appropriately augmenting and expanding well-built and granular third-party single-level ETF groupings.


title: Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer

abstract: Adversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a feature that is naturally irrelevant to most NLP tasks, and thus suitable for adversarial and backdoor attacks. In this paper, we make the first attempt to conduct adversarial and backdoor attacks based on text style transfer, which is aimed at altering the style of a sentence while preserving its meaning. We design an adversarial attack method and a backdoor attack method, and conduct extensive experiments to evaluate them. Experimental results show that popular NLP models are vulnerable to both adversarial and backdoor attacks based on text style transfer -- the attack success rates can exceed 90% without much effort. It reflects the limited ability of NLP models to handle the feature of text style that has not been widely realized. In addition, the style transfer-based adversarial and backdoor attack methods show superiority to baselines in many aspects. All the code and data of this paper can be obtained at https://github.com/thunlp/StyleAttack.


title: Accuracy of a one-dimensional reduction of dynamical systems on networks

abstract: Resilience is an ability of a system with which the system can adjust its activity to maintain its functionality when it is perturbed. To study resilience of dynamics on networks, Gao et al. proposed a theoretical framework to reduce dynamical systems on networks, which are high dimensional in general, to one-dimensional dynamical systems. The accuracy of this one-dimensional reduction relies on several assumption in addition to the assumption that the network has a negligible degree correlation. In the present study, we analyze the accuracy of the one-dimensional reduction assuming networks without degree correlation. We do so mainly through examining the validity of the individual assumptions underlying the method. Across five dynamical system models, we find that the accuracy of the one-dimensional reduction hinges on the spread of the equilibrium value of the state variable across the nodes in most cases. Specifically, the one-dimensional reduction tends to be accurate when the dispersion of the node's state is small. We also find that the correlation between the node's state and the node's degree, which is common for various dynamical systems on networks, is unrelated to the accuracy of the one-dimensional reduction.


title: SoGCN: Second-Order Graph Convolutional Networks

abstract: Graph Convolutional Networks (GCN) with multi-hop aggregation is more expressive than one-hop GCN but suffers from higher model complexity. Finding the shortest aggregation range that achieves comparable expressiveness and minimizes this side effect remains an open question. We answer this question by showing that multi-layer second-order graph convolution (SoGC) is sufficient to attain the ability of expressing polynomial spectral filters with arbitrary coefficients. Compared to models with one-hop aggregation, multi-hop propagation, and jump connections, SoGC possesses filter representational completeness while being lightweight, efficient, and easy to implement. Thereby, we suggest that SoGC is a simple design capable of forming the basic building block of GCNs, playing the same role as $3 \times 3$ kernels in CNNs. We build our Second-Order Graph Convolutional Networks (SoGCN) with SoGC and design a synthetic dataset to verify its filter fitting capability to validate these points. For real-world tasks, we present the state-of-the-art performance of SoGCN on the benchmark of node classification, graph classification, and graph regression datasets.


title: Short time existence for harmonic map heat flow with time-dependent metrics

abstract: In this work, we obtain a short time existence result for harmonic map heat flow coupled with a smooth family of complete metrics in the domain manifold. Our results generalize short time existence results for harmonic map heat flow by Li-Tam [The heat equation and harmonic maps of complete manifolds, Invent. Math., 1991] and Chen-Zhu [Uniqueness of the Ricci flow on complete noncompact manifolds, J. Differential Geometry, 2006]. In particular, we prove the short time existence of harmonic map heat flow along a complete Ricci flow $g(t)$ on $M$ into a complete manifold with curvature bounded from above with a smooth initial map of uniformly bounded energy density, under the assumptions that $|\text{Rm}(g(t))|\leq a/t$ and $g(t)$ is uniformly equivalent to $g(0)$.


title: bert2BERT: Towards Reusable Pretrained Language Models

abstract: In recent years, researchers tend to pre-train ever-larger language models to explore the upper limit of deep models. However, large language model pre-training costs intensive computational resources and most of the models are trained from scratch without reusing the existing pre-trained models, which is wasteful. In this paper, we propose bert2BERT, which can effectively transfer the knowledge of an existing smaller pre-trained model (e.g., BERT_BASE) to a large model (e.g., BERT_LARGE) through parameter initialization and significantly improve the pre-training efficiency of the large model. Specifically, we extend the previous function-preserving on Transformer-based language model, and further improve it by proposing advanced knowledge for large model's initialization. In addition, a two-stage pre-training method is proposed to further accelerate the training process. We did extensive experiments on representative PLMs (e.g., BERT and GPT) and demonstrate that (1) our method can save a significant amount of training cost compared with baselines including learning from scratch, StackBERT and MSLT; (2) our method is generic and applicable to different types of pre-trained models. In particular, bert2BERT saves about 45% and 47% computational cost of pre-training BERT_BASE and GPT_BASE by reusing the models of almost their half sizes. The source code will be publicly available upon publication.


title: Anti-Ramsey number of disjoint rainbow bases in all matroids

abstract: Consider a matroid $M=(E,\mathcal{I})$ with its elements of the ground set $E$ colored. A rainbow basis is a maximum independent set in which each element receives a different color. The rank of a subset $S$ of $E$, denoted by $r_M(S)$, is the maximum size of an independent set in $S$. A flat $F$ is a maximal set in $M$ with a fixed rank. The anti-Ramsey number of $t$ pairwise disjoint rainbow bases in $M$, denoted by $ar(M,t)$, is defined as the maximum number of colors $m$ such that there exists an $m$ coloring of the ground set $E$ of $M$ which contains no $t$ pairwise disjoint rainbow bases. We determine $ar(M,t)$ for all matroids of rank at least 2: $ar(M,t)=|E|$ if there exists a flat $F_0$ with $|E|-|F_0|<t(r_M(E)-r_M(F_0))$; and $ar(M,t)=\max_{F\colon r_M(F)\leq r_M(E)-2} \{|F|+t(r_M(E)-r_M(F)-1)\}$ otherwise. This generalizes Lu-Meier-Wang's previous result on the anti-Ramsey number of edge-disjoint rainbow spanning trees in any multigraph $G$.


title: SpongeCake: A Layered Microflake Surface Appearance Model

abstract: In this paper, we propose SpongeCake: a layered BSDF model where each layer is a volumetric scattering medium, defined using microflake or other phase functions. We omit any reflecting and refracting interfaces between the layers. The first advantage of this formulation is that an exact and analytic solution for single scattering, regardless of the number of volumetric layers, can be derived. We propose to approximate multiple scattering by an additional single-scattering lobe with modified parameters and a Lambertian lobe. We use a parameter mapping neural network to find the parameters of the newly added lobes to closely approximate the multiple scattering effect. Despite the absence of layer interfaces, we demonstrate that many common material effects can be achieved with layers of SGGX microflake and other volumes with appropriate parameters. A normal mapping effect can also be achieved through mapping of microflake orientations, which avoids artifacts common in standard normal maps. Thanks to the analytical formulation, our model is very fast to evaluate and sample. Through various parameter settings, our model is able to handle many types of materials, like plastics, wood, cloth, etc., opening a number of practical applications.


title: Prestressed elasticity of amorphous solids

abstract: Prestress in amorphous solids bears the memory of their formation, and plays a profound role in their mechanical properties, from stiffening or softening elastic moduli to shifting frequencies of vibrational modes, as well as directing yielding and solidification in the nonlinear regime. Here we develop a set of mathematical tools to investigate elasticity of prestressed discrete networks, which disentangles the effects from disorder in configuration and disorder in prestress. Applying these methods to prestressed triangular lattices and a computational model of amorphous solids, we demonstrate the importance of prestress on elasticity, and reveal a number of intriguing effects caused by prestress, including strong spatial heterogeneity in stress-response unique to prestressed solids, power-law distribution of minimal dipole stiffness, and a new criterion to classify floppy modes.


title: Unsupervised Data-Driven Nuclei Segmentation For Histology Images

abstract: An unsupervised data-driven nuclei segmentation method for histology images, called CBM, is proposed in this work. CBM consists of three modules applied in a block-wise manner: 1) data-driven color transform for energy compaction and dimension reduction, 2) data-driven binarization, and 3) incorporation of geometric priors with morphological processing. CBM comes from the first letter of the three modules - "Color transform", "Binarization" and "Morphological processing". Experiments on the MoNuSeg dataset validate the effectiveness of the proposed CBM method. CBM outperforms all other unsupervised methods and offers a competitive standing among supervised models based on the Aggregated Jaccard Index (AJI) metric.


title: Denominators in Lusztig's asymptotic Hecke algebra via the Plancherel formula

abstract: Let $\tilde{W}$ be an extended affine Weyl group, $\mathbf{H}$ be the corresponding affine Hecke algebra over the ring $\mathbb{C}[\mathbf{q}^\frac{1}{2}, \mathbf{q}^{-\frac{1}{2}}]$, and $J$ be Lusztig's asymptotic Hecke algebra, viewed as a based ring with basis $\{t_w\}$. Viewing $J$ as a subalgebra of the $(\mathbf{q}^{-\frac{1}{2}})$-adic completion of $\mathbf{H}$ via Lusztig's map $\phi$, we use Harish-Chandra's Plancherel formula for $p$-adic groups to show that the coefficient of $T_x$ in $t_w$ is a rational function of $\mathbf{q}$, depending only on the two-sided cell containing $w$, and with no poles outside of a finite set of roots of unity depending only on $\tilde{W}$. For $w$ in the lowest two-sided cell, and for all cells in types $\tilde{A}_n$, $\tilde{C}_2$, and $\tilde{G}_2$, we show that the denominators all divide a power of the Poincar\'{e} polynomial of the finite Weyl group. As an application, we conjecture that these denominators encode more detailed information about the failure of the Kazhdan-Lusztig classification at roots of the Poincar\'{e} polynomial than is currently known. Along the way, we show that upon specializing $\mathbf{q}=q>1$, the map from $J$ to the Harish-Chandra Schwartz algebra is injective. As an application of injectivity, we give a novel criterion for an Iwahori-spherical representation to have fixed vectors under a larger parahoric subgroup in terms of its Kazhdan-Lusztig parameter.


title: Smooth interpolation between thermal Born and LPM rates

abstract: In a weakly coupled ultrarelativistic plasma, $1 + n \leftrightarrow 2 + n$ scatterings, with $n \ge 0$, need sometimes to be summed to all orders, in order to determine a leading-order interaction rate. To implement this "LPM resummation", kinematic approximations are invoked. However, in cosmological settings, where the temperature changes by many orders of magnitude and both small and large momenta may play a role, such approximations are not always justified. We suggest a procedure to smoothly interpolate between LPM-resummed $1 + n \leftrightarrow 2 + n$ and Born-level $1 \leftrightarrow 2$ results, rendering the outcome applicable to a broader range of masses and momenta. The procedure is illustrated for right-handed neutrino production from a Standard Model plasma, and dilepton production from a QCD plasma.


title: Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation

abstract: Open-Domain Generative Question Answering has achieved impressive performance in English by combining document-level retrieval with answer generation. These approaches, which we refer to as GenQA, can generate complete sentences, effectively answering both factoid and non-factoid questions. In this paper, we extend GenQA to the multilingual and cross-lingual settings. For this purpose, we first introduce GenTyDiQA, an extension of the TyDiQA dataset with well-formed and complete answers for Arabic, Bengali, English, Japanese, and Russian. Based on GenTyDiQA, we design a cross-lingual generative model that produces full-sentence answers by exploiting passages written in multiple languages, including languages different from the question. Our cross-lingual generative system outperforms answer sentence selection baselines for all 5 languages and monolingual generative pipelines for three out of five languages studied.


title: Machine Learning, Deep Learning, and Hedonic Methods for Real Estate Price Prediction

abstract: In recent years several complaints about racial discrimination in appraising home values have been accumulating. For several decades, to estimate the sale price of the residential properties, appraisers have been walking through the properties, observing the property, collecting data, and making use of the hedonic pricing models. However, this method bears some costs and by nature is subjective and biased. To minimize human involvement and the biases in the real estate appraisals and boost the accuracy of the real estate market price prediction models, in this research we design data-efficient learning machines capable of learning and extracting the relation or patterns between the inputs (features for the house) and output (value of the houses). We compare the performance of some machine learning and deep learning algorithms, specifically artificial neural networks, random forest, and k nearest neighbor approaches to that of hedonic method on house price prediction in the city of Boulder, Colorado. Even though this study has been done over the houses in the city of Boulder it can be generalized to the housing market in any cities. The results indicate non-linear association between the dwelling features and dwelling prices. In light of these findings, this study demonstrates that random forest and artificial neural networks algorithms can be better alternatives over the hedonic regression analysis for prediction of the house prices in the city of Boulder, Colorado.


title: DeepSSM: A Blueprint for Image-to-Shape Deep Learning Models

abstract: Statistical shape modeling (SSM) characterizes anatomical variations in a population of shapes generated from medical images. SSM requires consistent shape representation across samples in shape cohort. Establishing this representation entails a processing pipeline that includes anatomy segmentation, re-sampling, registration, and non-linear optimization. These shape representations are then used to extract low-dimensional shape descriptors that facilitate subsequent analyses in different applications. However, the current process of obtaining these shape descriptors from imaging data relies on human and computational resources, requiring domain expertise for segmenting anatomies of interest. Moreover, this same taxing pipeline needs to be repeated to infer shape descriptors for new image data using a pre-trained/existing shape model. Here, we propose DeepSSM, a deep learning-based framework for learning the functional mapping from images to low-dimensional shape descriptors and their associated shape representations, thereby inferring statistical representation of anatomy directly from 3D images. Once trained using an existing shape model, DeepSSM circumvents the heavy and manual pre-processing and segmentation and significantly improves the computational time, making it a viable solution for fully end-to-end SSM applications. In addition, we introduce a model-based data-augmentation strategy to address data scarcity. Finally, this paper presents and analyzes two different architectural variants of DeepSSM with different loss functions using three medical datasets and their downstream clinical application. Experiments showcase that DeepSSM performs comparably or better to the state-of-the-art SSM both quantitatively and on application-driven downstream tasks. Therefore, DeepSSM aims to provide a comprehensive blueprint for deep learning-based image-to-shape models.


title: Estimation of Critical Collapse Solutions to Black Holes with Nonlinear Statistical Models

abstract: The self-similar gravitational collapse solutions to the Einstein-axion-dilaton system have already been found out. Those solutions become invariants after combining the spacetime dilation with the transformations of internal SL(2, R). We apply nonlinear statistical models to estimate the functions that appear in the physics of Black Holes of the axion-dilaton system in four dimensions. These statistical models include parametric polynomial regression, nonparametric kernel regression and semi-parametric local polynomial regression models. Through various numerical studies, we reached accurate numerical and closed-form continuously differentiable estimates for the functions appearing in the metric and equations of motion.

categories: gr-qc hep-th physics.comp-ph physics.data-an


title: Decay estimates for fourth-order Schr\"odinger operators in dimension two

abstract: In this paper we study the decay estimates of the fourth order Schr\"{o}dinger operator $H=\Delta^{2}+V(x)$ on $\mathbb{R}^2$ with a bounded decaying potential $V(x)$. We first deduce the asymptotic expansions of resolvent of $H$ near the zero threshold in the presence of resonances or eigenvalue, and then use them to establish the $L^1-L^\infty$ decay estimates of $e^{-itH}$generated by the fourth order Schr\"{o}dinger operator $H$. Our methods used in the decay estimates depend on Littlewood-Paley decomposition and oscillatory integral theory. Moreover, we classify these zero resonances as the distributional solutions of $H\phi=0$ in suitable weighted spaces. Due to the degeneracy of $\Delta^{2}$ at zero threshold and the lower even dimension (i.e. $n=2$), we remark that the asymptotic expansions of resolvent $R_V(\lambda^4)$ and the classifications of resonances are more involved than Schr\"odinger operator $-\Delta+V$ in dimension two.


title: Shuffle algebras, lattice paths and the commuting scheme

abstract: The commutative trigonometric shuffle algebra ${\mathrm A}$ is a space of symmetric rational functions satisfying certain wheel conditions. We describe a ring isomorphism between ${\mathrm A}$ and the center of the Hecke algebra using a realization of the elements of ${\mathrm A}$ as partition functions of coloured lattice paths associated to the $R$-matrix of $\mathcal U_{t^{1/2}}(\widehat{gl}_{\infty})$. As an application, we compute under certain conditions the Hilbert series of the commuting scheme and identify it with a particular element of the shuffle algebra ${\mathrm A}$, thus providing a combinatorial formula for it as a "domain wall" type partition function of coloured lattice paths.


title: Simple BSM explanations of $a_\mu$ in light of the FNAL muon $g-2$ measurement

abstract: Now that the Fermilab muon $g-2$ experiment has released the results of its Run-1 data, which agrees with the results of the Brookhaven experiment, one can examine the potential of simple extensions to explain the combined $4.2\sigma$ discrepancy between the SM prediction and experiment. This proceeding examines a single-, two-, and three-field extension of the standard model and examines their ability to explain the muon $g-2$ anomaly, and where possible, produce a dark matter candidate particle with the observed relic density. This is based on work carried out for Ref. [1]. It is found that one can only explain the $a_\mu$ discrepancy whilst avoiding dark matter and collider constraints when the contributions from BSM fields benefit from a chirality flip enhancement. However, in general without small couplings and/or large masses, these models can be heavily constrained by collider and dark matter experiments.


title: Bandwidth Utilization Side-Channel on ML Inference Accelerators

abstract: Accelerators used for machine learning (ML) inference provide great performance benefits over CPUs. Securing confidential model in inference against off-chip side-channel attacks is critical in harnessing the performance advantage in practice. Data and memory address encryption has been recently proposed to defend against off-chip attacks. In this paper, we demonstrate that bandwidth utilization on the interface between accelerators and the weight storage can serve a side-channel for leaking confidential ML model architecture. This side channel is independent of the type of interface, leaks even in the presence of data and memory address encryption and can be monitored through performance counters or through bus contention from an on-chip unprivileged process.


title: Entanglement of random hypergraph states

abstract: Random quantum states and operations are of fundamental and practical interests. In this work, we investigate the entanglement properties of random hypergraph states, which generalize the notion of graph states by applying generalized controlled-phase gates on an initial reference product state. In particular, we study the two ensembles generated by random Controlled-Z(CZ) and Controlled-Controlled-Z(CCZ) gates, respectively. By applying tensor network representation and combinational counting, we analytically show that the average subsystem purity and entanglement entropy for the two ensembles feature the same volume law, but greatly differ in typicality, namely the purity fluctuation is small and universal for the CCZ ensemble while it is large for the CZ ensemble. We discuss the implications of these results for the onset of entanglement complexity and quantum chaos.


title: Interpreting the Robustness of Neural NLP Models to Textual Perturbations

abstract: Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some perturbations than others. In this work, we test the hypothesis that the extent to which a model is affected by an unseen textual perturbation (robustness) can be explained by the learnability of the perturbation (defined as how well the model learns to identify the perturbation with a small amount of evidence). We further give a causal justification for the learnability metric. We conduct extensive experiments with four prominent NLP models -- TextRNN, BERT, RoBERTa and XLNet -- over eight types of textual perturbations on three datasets. We show that a model which is better at identifying a perturbation (higher learnability) becomes worse at ignoring such a perturbation at test time (lower robustness), providing empirical support for our hypothesis.


title: Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherence

abstract: This paper proposes a transformer over transformer framework, called Transformer$^2$, to perform neural text segmentation. It consists of two components: bottom-level sentence encoders using pre-trained transformers, and an upper-level transformer-based segmentation model based on the sentence embeddings. The bottom-level component transfers the pre-trained knowledge learned from large external corpora under both single and pair-wise supervised NLP tasks to model the sentence embeddings for the documents. Given the sentence embeddings, the upper-level transformer is trained to recover the segmentation boundaries as well as the topic labels of each sentence. Equipped with a multi-task loss and the pre-trained knowledge, Transformer$^2$ can better capture the semantic coherence within the same segments. Our experiments show that (1) Transformer$^2$ manages to surpass state-of-the-art text segmentation models in terms of a commonly-used semantic coherence measure; (2) in most cases, both single and pair-wise pre-trained knowledge contribute to the model performance; (3) bottom-level sentence encoders pre-trained on specific languages yield better performance than those pre-trained on specific domains.


title: Neural Attention-Aware Hierarchical Topic Model

abstract: Neural topic models (NTMs) apply deep neural networks to topic modelling. Despite their success, NTMs generally ignore two important aspects: (1) only document-level word count information is utilized for the training, while more fine-grained sentence-level information is ignored, and (2) external semantic knowledge regarding documents, sentences and words are not exploited for the training. To address these issues, we propose a variational autoencoder (VAE) NTM model that jointly reconstructs the sentence and document word counts using combinations of bag-of-words (BoW) topical embeddings and pre-trained semantic embeddings. The pre-trained embeddings are first transformed into a common latent topical space to align their semantics with the BoW embeddings. Our model also features hierarchical KL divergence to leverage embeddings of each document to regularize those of their sentences, thereby paying more attention to semantically relevant sentences. Both quantitative and qualitative experiments have shown the efficacy of our model in 1) lowering the reconstruction errors at both the sentence and document levels, and 2) discovering more coherent topics from real-world datasets.


title: Local regularity near boundary for the Stokes and Navier-Stokes equations

abstract: We are concerned with local regularity of the solutions for the Stokes and Navier-Stokes equations near boundary. Firstly, we construct a bounded solution but its normal derivatives are singular in any $L^p$ with $1<p$ locally near boundary. On the other hand, we present criteria of solutions of the Stokes equations near boundary to imply that the gradients of solutions are bounded (in fact, even further H\"{o}lder continuous). Finally, we provide examples of solutions whose local regularity near boundary is optimal.


title: A Data Analysis Study on Human Liver Blood Circulation

abstract: The liver has a unique blood supply system and plays an important role in the human blood circulatory system. Thus, hemodynamic problems related to the liver serve as an important part in clinical diagnosis and treatment. Although estimating parameters in these hemodynamic models is essential to the study of liver models, due to the limitations of medical measurement methods and constraints of ethics on clinical studies, it is impossible to directly measure the parameters of blood vessels in livers. Furthermore, as an important part of the systemic blood circulation, livers' studies are supposed to be in conjunction with other blood vessels. In this article, we present an innovative method to fix parameters of an individual liver in a human blood circulation using non-invasive clinical measurements. The method consists of a 1-D blood flow model of human arteries and veins, a 0-D model reflecting the peripheral resistance of capillaries and a lumped parameter circuit model for human livers. We apply the finite element method in fluid mechanics of these models to a numerical study, based on non-invasive blood related measures of 33 individuals. The estimated results of human blood vessel characteristic and liver model parameters are verified from the perspective of Stroke Value Variation, which shows the effectiveness of our estimation method.


title: AT2018lqh: Black Hole Born from a Rotating Star?

abstract: Recently an intriguing transient AT 2018lqh, with only a day-scale duration and a high luminosity of $7\times 10^{42}\ {\rm erg\ s^{-1}}$, has been discovered. While several possibilities are raised on its origin, the nature of this transient is yet to be unveiled. We propose that a black hole (BH) with $\sim 30\, M_\odot$ forming from a rotating blue supergiant can generate a transient like AT 2018lqh. We find that this scenario can consistently explain the optical/UV emission and the tentative late-time X-ray detection, as well as the radio upper limits. If super-Eddington accretion onto the nascent BH powers the X-ray emission, continued X-ray observations may be able to test the presence of an accretion disk around the BH.


title: Semantically Distributed Robust Optimization for Vision-and-Language Inference

abstract: Analysis of vision-and-language models has revealed their brittleness under linguistic phenomena such as paraphrasing, negation, textual entailment, and word substitutions with synonyms or antonyms. While data augmentation techniques have been designed to mitigate against these failure modes, methods that can integrate this knowledge into the training pipeline remain under-explored. In this paper, we present \textbf{SDRO}, a model-agnostic method that utilizes a set linguistic transformations in a distributed robust optimization setting, along with an ensembling technique to leverage these transformations during inference. Experiments on benchmark datasets with images (NLVR$^2$) and video (VIOLIN) demonstrate performance improvements as well as robustness to adversarial attacks. Experiments on binary VQA explore the generalizability of this method to other V\&L tasks.


title: CaPE: Contrastive Parameter Ensembling for Reducing Hallucination in Abstractive Summarization

abstract: Hallucination is a known issue for neural abstractive summarization models. Recent work suggests that the degree of hallucination may depend on errors in the training data. In this work, we propose a new method called Contrastive Parameter Ensembling (CaPE) to use training data more effectively, utilizing variations in noise in training samples to reduce hallucination. We first select clean and noisy subsets from the training data using different automatic factual metrics. Then, we fine-tune a base summarization model, which is trained on all training samples, on the clean (noisy) subset to obtain an \textit{expert} (\textit{anti-expert}) model. Finally, we adjust the parameters of base model by the difference between parameters of the \textit{expert} and \textit{anti-expert} models, steering the base model towards the \textit{expert} model and away from the \textit{anti-expert} model. Experimental results show that CaPE improves performance across different automatic factual metrics and human evaluation, with the maximum improvement of 16.69\% and 15.78\% on summary-level dependency-arc entailment accuracy for the XSUM and CNN/DM datasets. The improvement in factual performance does not degrade the performance on other metrics of informativeness such as ROUGE.


title: Mixed Mode Bursting Oscillations Induced by Birhythmicity and Noise

abstract: Bursting oscillations are commonly seen as a mechanism for information coding in neuroscience and have also been observed in many physical, biochemical, and chemical systems. This study focuses on the computational investigation of mixed-mode bursting oscillations (MMBOs) generated by a simple two-dimensional integrate-and-fire-or-burst (IFB) model. We demonstrate a new paradigm for the generation of MMBOs, where birhythmicity and noise are the key components. In the absence of noise, the proposed model exhibits birhythmicity of two independent bursting patterns, bursts of two spikes and bursts of three spikes, depending on the initial condition of the model. Noise induces the random transitions between two bursting states which leads to MMBOs, and the transition rate increases with the noise intensity. Our results provide a systematic view of the roles of noise and initial condition: the bursting dynamics produced by the proposed model heavily rely on the initial conditions when noise is weak; while for intermediate and strong noise, the burst dynamics are independent of the initial condition.


title: A Future-Input Dependent Path Integral for Quantum Mechanics

abstract: We here put forward a new path-integral over Hilbert space and show that it reproduces quantum mechanics exactly. This approach works by optimizing the generating functional under a variation of the final state; it is hence an example of a future-input dependent theory. The benefit of this method is that entangled states appear in the paths directly, and the generating functional can be modified to also include wave-function collapse.


title: Floquet engineering Hz-Level Rabi Spectra in Shallow Optical Lattice Clock

abstract: Quantum metrology with ultra-high precision usually requires atoms prepared in an ultra-stable environment with well-defined quantum states. Thus, in optical lattice clock systems deep lattice potentials are used to trap ultra-cold atoms. However, decoherence, induced by Raman scattering and higher order light shifts, can significantly be reduced if atomic clocks are realized in shallow optical lattices. On the other hand, in such lattices, tunneling among different sites can cause additional dephasing and strongly broadening of the Rabi spectrum. Here, in our experiment, we periodically drive a shallow $^{87}$Sr optical lattice clock. Counter intuitively, shaking the system can deform the wide broad spectral line into a sharp peak with 5.4Hz line-width. With careful comparison between the theory and experiment, we demonstrate that the Rabi frequency and the Bloch bands can be tuned, simultaneously and independently. Our work not only provides a different idea for quantum metrology, such as building shallow optical lattice clock in outer space, but also paves the way for quantum simulation of new phases of matter by engineering exotic spin orbit couplings.


title: Emergent properties of collective gene expression patterns in multicellular systems

abstract: Multicellular organisms comprise a diverse collection of stable tissues built from different cell types. It remains unclear how large numbers of interacting cells can precisely coordinate their gene expression during tissue self-organization. We develop a generalized model of multicellular gene expression that includes intracellular and intercellular gene interactions in tissue-like collectives. We show that tuning the intercellular signaling strength results in a cascade of transitions from single-cell autonomy towards different self-organized collective states. Despite an enormous number of possible tissue states, signaling tends to stabilize a small number of compositionally and spatially simple tissue types even for disordered interaction networks. Statistical properties of the stable phenotypes are preserved for different interaction networks and initial conditions. These results provide a theoretical framework to study how collections of cells in distinct organisms robustly self-organize into relatively simple tissues even for complex interaction networks mediated by large numbers of different molecules, and how different stable tissues are maintained in homeostasis and disease. The close alignment between this theoretical model of tissue self-organization and modern sequencing techniques, particularly spatial transcriptomics, will enable future applications in broad biological contexts.


title: SGoLAM: Simultaneous Goal Localization and Mapping for Multi-Object Goal Navigation

abstract: We present SGoLAM, short for simultaneous goal localization and mapping, which is a simple and efficient algorithm for Multi-Object Goal navigation. Given an agent equipped with an RGB-D camera and a GPS/Compass sensor, our objective is to have the agent navigate to a sequence of target objects in realistic 3D environments. Our pipeline fully leverages the strength of classical approaches for visual navigation, by decomposing the problem into two key components: mapping and goal localization. The mapping module converts the depth observations into an occupancy map, and the goal localization module marks the locations of goal objects. The agent's policy is determined using the information provided by the two modules: if a current goal is found, plan towards the goal and otherwise, perform exploration. As our approach does not require any training of neural networks, it could be used in an off-the-shelf manner, and amenable for fast generalization in new, unseen environments. Nonetheless, our approach performs on par with the state-of-the-art learning-based approaches. SGoLAM is ranked 2nd in the CVPR 2021 MultiON (Multi-Object Goal Navigation) challenge. We have made our code publicly available at \emph{https://github.com/eunsunlee/SGoLAM}.


title: Additive Schwarz Methods for Convex Optimization with Backtracking

abstract: This paper presents a novel backtracking strategy for additive Schwarz methods for general convex optimization problems as an acceleration scheme. The proposed backtracking strategy is independent of local solvers, so that it can be applied to any algorithms that can be represented in an abstract framework of additive Schwarz methods. Allowing for adaptive increasing and decreasing of the step size along the iterations, the convergence rate of an algorithm is greatly improved. Improved convergence rate of the algorithm is proven rigorously. In addition, combining the proposed backtracking strategy with a momentum acceleration technique, we propose a further accelerated additive Schwarz method. Numerical results for various convex optimization problems that support our theory are presented.


title: Adaptive Pad\'e-Chebyshev Type Approximation of Piecewise Smooth Functions

abstract: A piecewise Pad\'e-Chebyshev type (PiPCT) approximation method is proposed to minimize the Gibbs phenomenon in approximating piecewise smooth functions. A theorem on $L^1$-error estimate is proved for sufficiently smooth functions using a decay property of the Chebyshev coefficients. Numerical experiments are performed to show that the PiPCT method accurately captures isolated singularities of a function without using the positions and the types of singularities. Further, an adaptive partition approach to the PiPCT method is developed (referred to as the APiPCT method) to achieve the required accuracy with a lesser computational cost. Numerical experiments are performed to show some advantages of using the PiPCT and APiPCT methods compared to some well-known methods in the literature.


title: Context-gloss Augmentation for Improving Word Sense Disambiguation

abstract: The goal of Word Sense Disambiguation (WSD) is to identify the sense of a polysemous word in a specific context. Deep-learning techniques using BERT have achieved very promising results in the field and different methods have been proposed to integrate structured knowledge to enhance performance. At the same time, an increasing number of data augmentation techniques have been proven to be useful for NLP tasks. Building upon previous works leveraging BERT and WordNet knowledge, we explore different data augmentation techniques on context-gloss pairs to improve the performance of WSD. In our experiment, we show that both sentence-level and word-level augmentation methods are effective strategies for WSD. Also, we find out that performance can be improved by adding hypernyms' glosses obtained from a lexical knowledge base. We compare and analyze different context-gloss augmentation techniques, and the results show that applying back translation on gloss performs the best.


title: Identification of electrostatic two-stream instabilities associated with a laser-driven collisionless shock in a multicomponent plasma

abstract: Electrostatic two-stream instabilities play essential roles in an electrostatic collisionless shock formation. They are a key dissipation mechanism and result in ion heating and acceleration. Since the number and energy of the shock-accelerated ions depend on the instabilities, precise identification of the active instabilities is important. Two-dimensional particle-in-cell simulations in a multicomponent plasma reveal ion reflection and acceleration at the shock front, excitation of a longitudinally propagating electrostatic instability due to a non-oscillating component of the electrostatic field in the upstream region of the shock, and generation of up- and down-shifted velocity components within the expanding-ion components. A linear analysis of the instabilities for a C2H3Cl plasma using the one-dimensional electrostatic plasma dispersion function, which includes electron and ion temperature effects, shows that the most unstable mode is the electrostatic ion-beam two-stream instability (IBTI), which is weakly dependent on the existence of electrons. The IBTI is excited by velocity differences between the expanding protons and carbon-ion populations. There is an electrostatic electron-ion two-stream instability with a much smaller growth rate associated with a population of protons reflecting at the shock. The excitation of the fast-growing IBTI associated with laser-driven collisionless shock increases the brightness of a quasi-monoenergetic ion beam.


title: The subspace structure of maximum cliques in pseudo-Paley graphs from unions of cyclotomic classes

abstract: Blokhuis showed that all maximum cliques in Paley graphs of square order have a subfield structure. Recently it is shown that in Peisert-type graphs, some maximum cliques do not have a subfield structure, and yet all maximum cliques have a subspace structure. In this paper, we investigate the existence of a clique of size $\sqrt{q}$ with a subspace structure in pseudo-Paley graphs of order $q$ from unions of semi-primitive cyclotomic classes. We show that such a clique must have an equal contribution from each cyclotomic class and that most pseudo-Paley graphs do not admit such cliques, suggesting that the Delsarte bound $\sqrt{q}$ on the clique number can be improved in general. We also prove that generalized Peisert graphs are not isomorphic to Paley graphs or Peisert graphs, confirming a conjecture of Mullin.


title: Crystal bases of modified $\imath$quantum groups of certain quasi-split types

abstract: In order to see the behavior of $\imath$canonical bases at $q = \infty$, we introduce the notion of $\imath$crystals associated to an $\imath$quantum group of certain quasi-split type. The theory of $\imath$crystals clarifies why $\imath$canonical basis elements are not always preserved under natural homomorphisms. Also, we construct a projective system of $\imath$crystals whose projective limit can be thought of as the $\imath$canonical basis of the modified $\imath$quantum group at $q = \infty$.


title: Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

abstract: The common practice for training commonsense models has gone from-human-to-corpus-to-machine: humans author commonsense knowledge graphs in order to train commonsense models. In this work, we investigate an alternative, from-machine-to-corpus-to-machine: general language models author these commonsense knowledge graphs to train commonsense models. Our study leads to a new framework, Symbolic Knowledge Distillation. As with prior art in Knowledge Distillation (Hinton et al., 2015), our approach uses larger models to teach smaller models. A key difference is that we distill knowledge symbolically-as text-in addition to the neural model. We also distill only one aspect-the commonsense of a general language model teacher, allowing the student to be a different type, a commonsense model. Altogether, we show that careful prompt engineering and a separately trained critic model allow us to selectively distill high-quality causal commonsense from GPT-3, a general language model. Empirical results demonstrate that, for the first time, a human-authored commonsense knowledge graph is surpassed by our automatically distilled variant in all three criteria: quantity, quality, and diversity. In addition, it results in a neural commonsense model that surpasses the teacher model's commonsense capabilities despite its 100x smaller size. We apply this to the ATOMIC resource, and share our new symbolic knowledge graph and commonsense models.


title: Singular Zone in Quadrotor Yaw-Position Feedback Linearization

abstract: It is well known that the conventional quadrotor is an under-actuated MIMO system. The number of the inputs is less than the degree of freedom. One approach in controlling this non-holonomic system is feedback linearization. In the frequently cited (305 times) application, the yaw and the position are selected as the controlled variables. It is reported that no singularity is found in their delta matrix, making it possible to apply the inversion within a wide range. However, we find the ignored singular zone within the range of interest. The unreported singular area can cause the failure in the controller design. This paper visualizes this uninvertible area and details the deduction process.


title: Ab-initio study of ultrafast spin dynamics in Gdx(FeCo){1-x} alloys

abstract: Using an ultrashort laser pulse we explore {\it ab-initio} the spin dynamics of Gd$_x$(FeCo)$_{1-x}$ at femtosecond time scales. Optical excitations are found to drive charge from Fe majority $d$-states to the unoccupied Gd $f$-minority states, with $f$-electron character excited occupation lagging behind that of the $d$-electron character, leading to substantial demagnetisation of both species while leaving the global moment almost unchanged. For $x > 0.33$ this results in the creation of an ultrafast ferromagnetic (FM) transient by the end of the laser pulse, with the Gd demagnetization rate slower than that of Fe. For all concentrations the Gd moments begin to rotate from their ground state orientations developing in-plane moments of between 0.2-0.5~$\mu_B$. Thus, the ultrafast spin dynamics of the material captures three important ingredients of the all optical switching that occurs at much later (picosecond) times: (i) the development of a FM transient, (ii) the different rates of demagnetisation of Fe and Gd and, (iii), the breaking of the colinear symmetry of the ground state. Furthermore, several predictions are made about the behaviour of Fe-Gd alloys that can be experimentally tested and can lead to a spin-filtering device.


title: Relation-aware Heterogeneous Graph for User Profiling

abstract: User profiling has long been an important problem that investigates user interests in many real applications. Some recent works regard users and their interacted objects as entities of a graph and turn the problem into a node classification task. However, they neglect the difference of distinct interaction types, e.g. user clicks an item v.s.user purchases an item, and thus cannot incorporate such information well. To solve these issues, we propose to leverage the relation-aware heterogeneous graph method for user profiling, which also allows capturing significant meta relations. We adopt the query, key, and value mechanism in a transformer fashion for heterogeneous message passing so that entities can effectively interact with each other. Via such interactions on different relation types, our model can generate representations with rich information for the user profile prediction. We conduct experiments on two real-world e-commerce datasets and observe a significant performance boost of our approach.


title: Adversarial examples by perturbing high-level features in intermediate decoder layers

abstract: We propose a novel method for creating adversarial examples. Instead of perturbing pixels, we use an encoder-decoder representation of the input image and perturb intermediate layers in the decoder. This changes the high-level features provided by the generative model. Therefore, our perturbation possesses semantic meaning, such as a longer beak or green tints. We formulate this task as an optimization problem by minimizing the Wasserstein distance between the adversarial and initial images under a misclassification constraint. We employ the projected gradient method with a simple inexact projection. Due to the projection, all iterations are feasible, and our method always generates adversarial images. We perform numerical experiments on the MNIST and ImageNet datasets in both targeted and untargeted settings. We demonstrate that our adversarial images are much less vulnerable to steganographic defence techniques than pixel-based attacks. Moreover, we show that our method modifies key features such as edges and that defence techniques based on adversarial training are vulnerable to our attacks.


title: High-Dimensional Entanglement of Photonic Angular Qudits

abstract: We propose a method for generation of entangled photonic states in high dimensions, the so-called qudits, by exploiting quantum correlations of Orbital Angular Momentum (OAM) entangled photons, produced via Spontaneous Parametric Down Conversion. Diffraction masks containing $N$ angular slits placed in the path of twin photons define a qudit space of dimension $N^2$, spanned by the alternative pathways of OAM-entangled photons. We quantify the high-dimensional entanglement of path-entangled photons by the Concurrence, using an analytic expression valid for pure states. We report numerical results for the Concurrence as a function of the angular aperture size for the case of high-dimensional OAM entanglement and for the case of high-dimensional path entanglement, produced by $N \times M$ angular slits. Our results provide additional means for preparation and characterization of entangled quantum states in high-dimensions, a fundamental resource for quantum simulation and quantum information protocols.


title: Self-Supervised Domain Adaptation for Visual Navigation with Global Map Consistency

abstract: We propose a light-weight, self-supervised adaptation for a visual navigation agent to generalize to unseen environment. Given an embodied agent trained in a noiseless environment, our objective is to transfer the agent to a noisy environment where actuation and odometry sensor noise is present. Our method encourages the agent to maximize the consistency between the global maps generated at different time steps in a round-trip trajectory. The proposed task is completely self-supervised, not requiring any supervision from ground-truth pose data or explicit noise model. In addition, optimization of the task objective is extremely light-weight, as training terminates within a few minutes on a commodity GPU. Our experiments show that the proposed task helps the agent to successfully transfer to new, noisy environments. The transferred agent exhibits improved localization and mapping accuracy, further leading to enhanced performance in downstream visual navigation tasks. Moreover, we demonstrate test-time adaptation with our self-supervised task to show its potential applicability in real-world deployment.


title: VLBInet: Radio Interferometry Data Classification for EHT with Neural Networks

abstract: The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for the EHT is how well key parameters, such as trapped magnetic flux and the associated disk models, can be extracted from present and future EHT VLBI data products. The process of modeling visibilities and analyzing them is complicated by the fact that the data are sparsely sampled in the Fourier domain while most of the theory/simulation is constructed in the image domain. Here we propose a data-driven approach to analyze complex visibilities and closure quantities for radio interferometric data with neural networks. Using mock interferometric data, we show that our neural networks are able to infer the accretion state as either high magnetic flux (MAD) or low magnetic flux (SANE), suggesting that it is possible to perform parameter extraction directly in the visibility domain without image reconstruction. We have applied VLBInet to real M87 EHT data taken on four different days in 2017 (April 5, 6, 10, 11), and our neural networks give a score prediction 0.52, 0.4, 0.43, 0.76 for each day, with an average score 0.53, which shows no significant indication for the data to lean toward either the MAD or SANE state.


title: An FPGA-Based Fully Pipelined Bilateral Grid for Real-Time Image Denoising

abstract: The bilateral filter (BF) is widely used in image processing because it can perform denoising while preserving edges. It has disadvantages in that it is nonlinear, and its computational complexity and hardware resources are directly proportional to its window size. Thus far, several approximation methods and hardware implementations have been proposed to solve these problems. However, processing large-scale and high-resolution images in real time under severe hardware resource constraints remains a challenge. This paper proposes a real-time image denoising system that uses an FPGA based on the bilateral grid (BG). In the BG, a 2D image consisting of x- and y-axes is projected onto a 3D space called a "grid," which consists of axes that correlate to the x-component, y-component, and intensity value of the input image. This grid is then blurred using the Gaussian filter, and the output image is generated by interpolating the grid. Although it is possible to change the window size in the BF, it is impossible to change it on the input image in the BG. This makes it difficult to associate the BG with the BF and to obtain the property of suppressing the increase in hardware resources when the window radius is enlarged. This study demonstrates that a BG with a variable-sized window can be realized by introducing the window radius parameter wherein the window radius on the grid is always 1. We then implement this BG on an FPGA in a fully pipelined manner. Further, we verify that our design suppresses the increase in hardware resources even when the window size is enlarged and outperforms the existing designs in terms of computation speed and hardware resources.


title: Revisiting IPA-based Cross-lingual Text-to-speech

abstract: International Phonetic Alphabet (IPA) has been widely used in cross-lingual text-to-speech (TTS) to achieve cross-lingual voice cloning (CL VC). However, IPA itself has been understudied in cross-lingual TTS. In this paper, we report some empirical findings of building a cross-lingual TTS model using IPA as inputs. Experiments show that the way to process the IPA and suprasegmental sequence has a negligible impact on the CL VC performance. Furthermore, we find that using a dataset including one speaker per language to build an IPA-based TTS system would fail CL VC since the language-unique IPA and tone/stress symbols could leak the speaker information. In addition, we experiment with different combinations of speakers in the training dataset to further investigate the effect of the number of speakers on the CL VC performance.


title: Does the Layout Really Matter? A Study on Visual Model Accuracy Estimation

abstract: In visual interactive labeling, users iteratively assign labels to data items until the machine model reaches an acceptable accuracy. A crucial step of this process is to inspect the model's accuracy and decide whether it is necessary to label additional elements. In scenarios with no or very little labeled data, visual inspection of the predictions is required. Similarity-preserving scatterplots created through a dimensionality reduction algorithm are a common visualization that is used in these cases. Previous studies investigated the effects of layout and image complexity on tasks like labeling. However, model evaluation has not been studied systematically. We present the results of an experiment studying the influence of image complexity and visual grouping of images on model accuracy estimation. We found that users outperform traditional automated approaches when estimating a model's accuracy. Furthermore, while the complexity of images impacts the overall performance, the layout of the items in the plot has little to no effect on estimations.


title: Robust filtering of sequences with periodically stationary multiplicative seasonal increments

abstract: We study stochastic sequences $\xi(k)$ with periodically stationary generalized multiple increments of fractional order which combines cyclostationary, multi-seasonal, integrated and fractionally integrated patterns. We solve the filtering problem for linear functionals constructed from unobserved values of a stochastic sequence $\xi(k)$ based on observations with the periodically stationary noise sequence. For sequences with known matrices of spectral densities, we obtain formulas for calculating values of the mean square errors and the spectral characteristics of the optimal estimates of the functionals. Formulas that determine the least favorable spectral densities and minimax (robust) spectral characteristics of the optimal linear estimates of the functionals are proposed in the case where spectral densities of sequences are not exactly known while some sets of admissible spectral densities are given.