title: A comparative study of the performance of different search algorithms on FOON graphs

abstract: A robot finds it really hard to learn creatively and adapt to new unseen challenges. This is mainly because of the minimal information it has access to or experience towards. Paulius et al. [1] presented a way to construct functional graphs that encapsulate. Sakib et al. [2] further expanded FOON objects for robotic cooking. This paper presents a comparative study of Breadth First Search (BFS), Greedy Breadth First search (GBFS) with two heuristic functions, and Iterative Depth First Search (IDFS) and provides a comparison of their performance.


title: Schwinger-Dyson truncations in the all-soft limit: a case study

abstract: We study a special Schwinger-Dyson equation in the context of a pure SU(3) Yang-Mills theory, formulated in the background field method. Specifically, we consider the corresponding equation for the vertex that governs the interaction of two background gluons with a ghost-antighost pair. By virtue of the background gauge invariance, this vertex satisfies a naive Slavnov-Taylor identity, which is not deformed by the ghost sector of the theory. In the all-soft limit, where all momenta vanish, the form of this vertex may be obtained exactly from the corresponding Ward identity. This special result is subsequently reproduced at the level of the Schwinger-Dyson equation, by making extensive use of Taylor's theorem and exploiting a plethora of key relations, particular to the background field method. This information permits the determination of the error associated with two distinct truncation schemes, where the potential advantage from employing lattice data for the ghost dressing function is quantitatively assessed.


title: CaloDVAE : Discrete Variational Autoencoders for Fast Calorimeter Shower Simulation

abstract: Calorimeter simulation is the most computationally expensive part of Monte Carlo generation of samples necessary for analysis of experimental data at the Large Hadron Collider (LHC). The High-Luminosity upgrade of the LHC would require an even larger amount of such samples. We present a technique based on Discrete Variational Autoencoders (DVAEs) to simulate particle showers in Electromagnetic Calorimeters. We discuss how this work paves the way towards exploration of quantum annealing processors as sampling devices for generation of simulated High Energy Physics datasets.


title: PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation

abstract: Existing work on controlled text generation (CTG) assumes a control interface of categorical attributes. In this work, we propose a natural language (NL) interface, where we craft a PCFG to embed the control attributes into natural language commands, and propose variants of existing CTG models that take commands as input. In our experiments, we design tailored setups to test model's generalization abilities. We find our PCFG-based command generation approach is effective for handling unseen commands compared to fix-set templates; our proposed NL models can effectively generalize to unseen attributes, a new ability enabled by the NL interface, as well as unseen attribute combinations. Interestingly, we discover that the simple conditional generation approach, enhanced with our proposed NL interface, is a strong baseline in those challenging settings.


title: Monte Carlo Augmented Actor-Critic for Sparse Reward Deep Reinforcement Learning from Suboptimal Demonstrations

abstract: Providing densely shaped reward functions for RL algorithms is often exceedingly challenging, motivating the development of RL algorithms that can learn from easier-to-specify sparse reward functions. This sparsity poses new exploration challenges. One common way to address this problem is using demonstrations to provide initial signal about regions of the state space with high rewards. However, prior RL from demonstrations algorithms introduce significant complexity and many hyperparameters, making them hard to implement and tune. We introduce Monte Carlo Augmented Actor Critic (MCAC), a parameter free modification to standard actor-critic algorithms which initializes the replay buffer with demonstrations and computes a modified $Q$-value by taking the maximum of the standard temporal distance (TD) target and a Monte Carlo estimate of the reward-to-go. This encourages exploration in the neighborhood of high-performing trajectories by encouraging high $Q$-values in corresponding regions of the state space. Experiments across $5$ continuous control domains suggest that MCAC can be used to significantly increase learning efficiency across $6$ commonly used RL and RL-from-demonstrations algorithms. See https://sites.google.com/view/mcac-rl for code and supplementary material.


title: AERIQ: SDR-Based LTE I/Q Measurement and Analysis Framework for Air-to-Ground Propagation Modeling

abstract: In this paper, we introduce AERIQ: a software-defined radio (SDR) based I/Q measurement and analysis framework for wireless signals for aerial experimentation. AERIQ is integrated into controllable aerial vehicles, it is flexible, repeatable, and provides raw I/Q samples for post-processing the data to extract various key parameters of interest (KPIs) over a 3D volume. Using SDRs, we collect I/Q data with unmanned aerial vehicles (UAVs) flying at various altitudes in a radio dynamic zone (RDZ) like outdoor environment, from a 4G LTE eNB that we configure to operate at 3.51 GHz. Using the raw I/Q samples, and using Matlab's LTE Toolbox, we provide a step-by-step description for frequency offset estimation/correction, synchronization, cell search, channel estimation, and reference signal received power (RSRP). We provide various representative results for each step, such as RSRP measurements and corresponding analytical approximation at different UAV altitudes, coherence bandwidth and coherence time of the channel at different UAV altitudes and link distances, and kriging based 3D RSRP interpolation. The collected raw data as well as the software developed for obtaining and post-processing such data are provided publicly for potential use by other researchers. AERIQ is also available in emulation and testbed environments for external researchers to access and use as part of the NSF AERPAW platform at NC State University.


title: Asymptotic free independence and entry permutations for Gaussian random matrices. Part II: Infinitesimal freeness

abstract: We study asymptotic infinitesimal distribution of Gaussian Unitary Ensembles with permuted entries. We show that for random uniform permutation asymptotically permuted GUE matrix has null infinitesimal distribution. Moreover we show that asymptotically different permutations of the same GUE matrix are infinitesimally free. Besides this we study particular example of entry permutation - the transpose and we show that while a GUE matrix is asymptotically free from its transpose it is not infinitesimally free from it.


title: NOCaL: Calibration-Free Semi-Supervised Learning of Odometry and Camera Intrinsics

abstract: There are a multitude of emerging imaging technologies that could benefit robotics. However the need for bespoke models, calibration and low-level processing represents a key barrier to their adoption. In this work we present NOCaL, Neural odometry and Calibration using Light fields, a semi-supervised learning architecture capable of interpreting previously unseen cameras without calibration. NOCaL learns to estimate camera parameters, relative pose, and scene appearance. It employs a scene-rendering hypernetwork pretrained on a large number of existing cameras and scenes, and adapts to previously unseen cameras using a small supervised training set to enforce metric scale. We demonstrate NOCaL on rendered and captured imagery using conventional cameras, demonstrating calibration-free odometry and novel view synthesis. This work represents a key step toward automating the interpretation of general camera geometries and emerging imaging technologies.


title: Smart Headset, Computer Vision and Machine Learning for Efficient Prawn Farm Management

abstract: Understanding the growth and distribution of the prawns is critical for optimising the feed and harvest strategies. An inadequate understanding of prawn growth can lead to reduced financial gain, for example, crops are harvested too early. The key to maintaining a good understanding of prawn growth is frequent sampling. However, the most commonly adopted sampling practice, the cast net approach, is unable to sample the prawns at a high frequency as it is expensive and laborious. An alternative approach is to sample prawns from feed trays that farm workers inspect each day. This will allow growth data collection at a high frequency (each day). But measuring prawns manually each day is a laborious task. In this article, we propose a new approach that utilises smart glasses, depth camera, computer vision and machine learning to detect prawn distribution and growth from feed trays. A smart headset was built to allow farmers to collect prawn data while performing daily feed tray checks. A computer vision + machine learning pipeline was developed and demonstrated to detect the growth trends of prawns in 4 prawn ponds over a growing season.


title: Upper bounds on the Rate of Uniformly-Random Codes for the Deletion Channel

abstract: We consider the maximum coding rate achievable by uniformly-random codes for the deletion channel. We prove an upper bound that's within 0.1 of the best known lower bounds for all values of the deletion probability $d,$ and much closer for small and large $d.$ We give simulation results which suggest that our upper bound is within 0.05 of the exact value for all $d$, and within $0.01$ for $d>0.75$. Despite our upper bounds, based on simulations, we conjecture that a positive rate is achievable with uniformly-random codes for all deletion probabilities less than 1. Our results imply impossibility results for the (equivalent) problem of compression of i.i.d. sources correlated via the deletion channel, a relevant model for DNA storage.


title: Relations Between Discrete Maximal Operators in Harmonic Analysis

abstract: In this paper, we define several types of maximal operators on sequence spaces occuring in Harmonic analysis and present various connections between them.


title: Risk-Awareness in Learning Neural Controllers for Temporal Logic Objectives

abstract: In this paper, we consider the problem of synthesizing a controller in the presence of uncertainty such that the resulting closed-loop system satisfies certain hard constraints while optimizing certain (soft) performance objectives. We assume that the hard constraints encoding safety or mission-critical task objectives are expressed using Signal Temporal Logic (STL), while performance is quantified using standard cost functions on system trajectories. In order to prioritize the satisfaction of the hard STL constraints, we utilize the framework of control barrier functions (CBFs) and algorithmically obtain CBFs for STL objectives. We assume that the controllers are modeled using neural networks (NNs) and provide an optimization algorithm to learn the optimal parameters for the NN controller that optimize the performance at a user-specified robustness margin for the safety specifications. We use the formalism of risk measures to evaluate the risk incurred by the trade-off between robustness margin of the system and its performance. We demonstrate the efficacy of our approach on well-known difficult examples for nonlinear control such as a quad-rotor and a unicycle, where the mission objectives for each system include hard timing constraints and safety objectives.


title: InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions

abstract: Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information 'fairly,' with explanations, rather than blindly eliminating it. This fair balance is often subjective and can be challenging to achieve algorithmically. We explore two interactive setups with a frozen predictive model and show that users able to provide feedback can achieve a better and fairer balance between task performance and bias mitigation. In one setup, users, by interacting with test examples, further decreased bias in the explanations (5-8%) while maintaining the same prediction accuracy. In the other setup, human feedback was able to disentangle associated bias and predictive information from the input leading to superior bias mitigation and improved task performance (4-5%) simultaneously.


title: Characterizing the Influence of Graph Elements

abstract: Influence function, a method from robust statistics, measures the changes of model parameters or some functions about model parameters concerning the removal or modification of training instances. It is an efficient and useful post-hoc method for studying the interpretability of machine learning models without the need for expensive model re-training. Recently, graph convolution networks (GCNs), which operate on graph data, have attracted a great deal of attention. However, there is no preceding research on the influence functions of GCNs to shed light on the effects of removing training nodes/edges from an input graph. Since the nodes/edges in a graph are interdependent in GCNs, it is challenging to derive influence functions for GCNs. To fill this gap, we started with the simple graph convolution (SGC) model that operates on an attributed graph and formulated an influence function to approximate the changes in model parameters when a node or an edge is removed from an attributed graph. Moreover, we theoretically analyzed the error bound of the estimated influence of removing an edge. We experimentally validated the accuracy and effectiveness of our influence estimation function. In addition, we showed that the influence function of an SGC model could be used to estimate the impact of removing training nodes/edges on the test performance of the SGC without re-training the model. Finally, we demonstrated how to use influence functions to guide the adversarial attacks on GCNs effectively.


title: Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Clouds

abstract: We study how choices of input point cloud coordinate frames impact learning of manipulation skills from 3D point clouds. There exist a variety of coordinate frame choices to normalize captured robot-object-interaction point clouds. We find that different frames have a profound effect on agent learning performance, and the trend is similar across 3D backbone networks. In particular, the end-effector frame and the target-part frame achieve higher training efficiency than the commonly used world frame and robot-base frame in many tasks, intuitively because they provide helpful alignments among point clouds across time steps and thus can simplify visual module learning. Moreover, the well-performing frames vary across tasks, and some tasks may benefit from multiple frame candidates. We thus propose FrameMiners to adaptively select candidate frames and fuse their merits in a task-agnostic manner. Experimentally, FrameMiners achieves on-par or significantly higher performance than the best single-frame version on five fully physical manipulation tasks adapted from ManiSkill and OCRTOC. Without changing existing camera placements or adding extra cameras, point cloud frame mining can serve as a free lunch to improve 3D manipulation learning.


title: MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

abstract: In most E-commerce platforms, whether the displayed items trigger the user's interest largely depends on their most eye-catching multimodal content. Consequently, increasing efforts focus on modeling multimodal user preference, and the pressing paradigm is to incorporate complete multimodal deep features of the items into the recommendation module. However, the existing studies ignore the mismatch problem between multimodal feature extraction (MFE) and user interest modeling (UIM). That is, MFE and UIM have different emphases. Specifically, MFE is migrated from and adapted to upstream tasks such as image classification. In addition, it is mainly a content-oriented and non-personalized process, while UIM, with its greater focus on understanding user interaction, is essentially a user-oriented and personalized process. Therefore, the direct incorporation of MFE into UIM for purely user-oriented tasks, tends to introduce a large number of preference-independent multimodal noise and contaminate the embedding representations in UIM. This paper aims at solving the mismatch problem between MFE and UIM, so as to generate high-quality embedding representations and better model multimodal user preferences. Towards this end, we develop a novel model, MEGCF. The UIM of the proposed model captures the semantic correlation between interactions and the features obtained from MFE, thus making a better match between MFE and UIM. More precisely, semantic-rich entities are first extracted from the multimodal data, since they are more relevant to user preferences than other multimodal information. These entities are then integrated into the user-item interaction graph. Afterwards, a symmetric linear Graph Convolution Network (GCN) module is constructed to perform message propagation over the graph, in order to capture both high-order semantic correlation and collaborative filtering signals.


title: Uniqueness of conformal metrics with constant Q-curvature on closed Einstein manifolds

abstract: On a smooth, closed Riemannian manifold $(M,g)$ of dimension $n\ge3$ with positive scalar curvature and not conformally diffeomorphic to the standard sphere, we prove that the only conformal metrics to $g$ with constant Q-curvature of order 4 are the metrics $\lambda g$ with $\lambda>0$ constant.


title: An efficient low-density grating setup for monochromatization of XUV ultrafast light sources

abstract: Ultrafast light sources have become an indispensable tool to access and understand transient phenomenon in material science. However, a simple and easy-to-implement method for harmonic selection, with high transmission efficiency and pulse duration conservation, is still a challenge. Here we showcase and compare two approaches for selecting the desired harmonic from a high harmonic generation source while achieving the above goals. The first approach is the combination of extreme ultraviolet spherical mirrors with transmission filters and the second approach uses a normal-incidence spherical grating. Both solutions target time- and angle-resolved photoemission spectroscopy with photon energies in the 10-20 eV range but are relevant for other experimental techniques as well. The two approaches for harmonic selection are characterized in terms of focusing quality, efficiency, and temporal broadening. It is demonstrated that a focusing grating is able to provide much higher transmission as compared to the mirror+filter approach (3.3 times higher for 10.8 eV and 12.9 times higher for 18.1 eV), with only a slight temporal broadening (6.8% increase) and a somewhat larger spot size (~30% increase). Overall, our study establishes an experimental perspective on the trade-off between a single grating normal incidence monochromator design and the use of filters. As such, it provides a basis for selecting the most appropriate approach in various fields where an easy-to-implement harmonic selection from high harmonic generation is needed.


title: An empirical method for mitigating an excess up-scattering mass bias on the weak lensing mass estimates for shear-selected cluster samples

abstract: An excess up-scattering mass bias on a weak lensing cluster mass estimate is a statistical bias that an observed weak lensing mass ($M_{\rm obs}$) of a cluster of galaxies is, in a statistical sense, larger than its true mass ($M_{\rm true}$) because of a higher chance of up-scattering than that of down-scattering due to random noises in a weak lensing cluster shear profile. This non-symmetric scattering probability is caused by a monotonically decreasing cluster mass function with increasing mass. We examine this bias (defined by $b=M_{\rm obs}/M_{\rm true}$) in weak lensing shear-selected clusters, and present an empirical method for mitigating it. In so doing, we perform the standard weak lensing mass estimate of realistic mock clusters, and find that the weak lensing mass estimate based on the standard $\chi^2$ analysis gives a statistically correct confidence intervals, but resulting best-fitting masses are biased high on average. Our correction method uses the framework of the standard Bayesian statistics with the prior of the probability distribution of the cluster mass and concentration parameter from recent empirical models. We test our correction method using mock weak lensing clusters, and find that the method works well with resulting corrected $M_{\rm obs}$-bin averaged mass biases being close to unity within $\sim 10$ percent. We applied the correction method to weak lensing shear-selected cluster sample of Hamana et al. (2020), and present bias-corrected weak lensing cluster masses.


title: Multilingual Word Sense Disambiguation with Unified Sense Representation

abstract: As a key natural language processing (NLP) task, word sense disambiguation (WSD) evaluates how well NLP models can understand the lexical semantics of words under specific contexts. Benefited from the large-scale annotation, current WSD systems have achieved impressive performances in English by combining supervised learning with lexical knowledge. However, such success is hard to be replicated in other languages, where we only have limited annotations.In this paper, based on the multilingual lexicon BabelNet describing the same set of concepts across languages, we propose building knowledge and supervised-based Multilingual Word Sense Disambiguation (MWSD) systems. We build unified sense representations for multiple languages and address the annotation scarcity problem for MWSD by transferring annotations from rich-sourced languages to poorer ones. With the unified sense representations, annotations from multiple languages can be jointly trained to benefit the MWSD tasks. Evaluations of SemEval-13 and SemEval-15 datasets demonstrate the effectiveness of our methodology.


title: Evaluating Out-of-Distribution Performance on Document Image Classifiers

abstract: The ability of a document classifier to handle inputs that are drawn from a distribution different from the training distribution is crucial for robust deployment and generalizability. The RVL-CDIP corpus is the de facto standard benchmark for document classification, yet to our knowledge all studies that use this corpus do not include evaluation on out-of-distribution documents. In this paper, we curate and release a new out-of-distribution benchmark for evaluating out-of-distribution performance for document classifiers. Our new out-of-distribution benchmark consists of two types of documents: those that are not part of any of the 16 in-domain RVL-CDIP categories (RVL-CDIP-O), and those that are one of the 16 in-domain categories yet are drawn from a distribution different from that of the original RVL-CDIP dataset (RVL-CDIP-N). While prior work on document classification for in-domain RVL-CDIP documents reports high accuracy scores, we find that these models exhibit accuracy drops of between roughly 15-30% on our new out-of-domain RVL-CDIP-N benchmark, and further struggle to distinguish between in-domain RVL-CDIP-N and out-of-domain RVL-CDIP-O inputs. Our new benchmark provides researchers with a valuable new resource for analyzing out-of-distribution performance on document classifiers. Our new out-of-distribution data can be found at https://github.com/gxlarson/rvl-cdip-ood.


title: G2A2: An Automated Graph Generator with Attributes and Anomalies

abstract: Many data-mining applications use dynamic attributed graphs to represent relational information; but due to security and privacy concerns, there is a dearth of available datasets that can be represented as dynamic attributed graphs. Even when such datasets are available, they do not have ground truth that can be used to train deep-learning models. Thus, we present G2A2, an automated graph generator with attributes and anomalies, which encompasses (1) probabilistic models to generate a dynamic bipartite graph, representing time-evolving connections between two independent sets of entities, (2) realistic injection of anomalies using a novel algorithm that captures the general properties of graph anomalies across domains, and (3) a deep generative model to produce realistic attributes, learned from an existing real-world dataset. Using the maximum mean discrepancy (MMD) metric to evaluate the realism of a G2A2-generated graph against three real-world graphs, G2A2 outperforms Kronecker graph generation by reducing the MMD distance by up to six-fold (6x).


title: ExAug: Robot-Conditioned Navigation Policies via Geometric Experience Augmentation

abstract: Machine learning techniques rely on large and diverse datasets for generalization. Computer vision, natural language processing, and other applications can often reuse public datasets to train many different models. However, due to differences in physical configurations, it is challenging to leverage public datasets for training robotic control policies on new robot platforms or for new tasks. In this work, we propose a novel framework, ExAug to augment the experiences of different robot platforms from multiple datasets in diverse environments. ExAug leverages a simple principle: by extracting 3D information in the form of a point cloud, we can create much more complex and structured augmentations, utilizing both generating synthetic images and geometric-aware penalization that would have been suitable in the same situation for a different robot, with different size, turning radius, and camera placement. The trained policy is evaluated on two new robot platforms with three different cameras in indoor and outdoor environments with obstacles.


title: Neural Network Compression by Joint Sparsity Promotion and Redundancy Reduction

abstract: Compression of convolutional neural network models has recently been dominated by pruning approaches. A class of previous works focuses solely on pruning the unimportant filters to achieve network compression. Another important direction is the design of sparsity-inducing constraints which has also been explored in isolation. This paper presents a novel training scheme based on composite constraints that prune redundant filters and minimize their effect on overall network learning via sparsity promotion. Also, as opposed to prior works that employ pseudo-norm-based sparsity-inducing constraints, we propose a sparse scheme based on gradient counting in our framework. Our tests on several pixel-wise segmentation benchmarks show that the number of neurons and the memory footprint of networks in the test phase are significantly reduced without affecting performance. MobileNetV3 and UNet, two well-known architectures, are used to test the proposed scheme. Our network compression method not only results in reduced parameters but also achieves improved performance compared to MobileNetv3, which is an already optimized architecture.


title: Temperature Fluctuations in Quasar Accretion Discs from Spectroscopic Monitoring Data

abstract: Neustadt & Kochanek (2022, hereafter NK22) proposed a new method to reconstruct the temperature perturbation map (as functions of time and disc radius) of AGN accretion discs using multi-wavelength photometric light curves. We apply their technique to 100 quasars at $z=0.5-2$ from the Sloan Digital Sky Survey Reverberation Mapping project, using multi-epoch spectroscopy that covers rest-frame UV-optical continuum emission from the quasar and probes days to months timescales. Consistent with NK22 for low-redshift AGNs, we find that the dominant pattern of disc temperature perturbations is either slow inward/outward moving waves with typical amplitudes $\delta T/T_0\sim 10\%$ traveling at $\sim 0.01-0.1c$, with a typical radial frequency of $\sim$ 0.5 dex in $\log R$, or incoherent perturbations. In nearly none of the cases do we find clear evidence for coherent, fast outgoing temperature perturbations at the speed of light, reminiscent of the lamppost model; but such lamppost signals may be present in some quasars for limited periods of the monitoring data. Using simulated data, we demonstrate that high-fidelity temperature perturbation maps can be recovered with high-quality monitoring spectroscopy, with limited impact from seasonal gaps in the data. On the other hand, reasonable temperature perturbation maps can be reconstructed with high-cadence photometric light curves from the Vera C. Rubin Observatory Legacy Survey of Space and Time. Our findings, together with NK22, suggest that internal disc processes are the main driver for temperature fluctuations in AGN accretion discs over days to months timescales.


title: Using Graph Algorithms to Pretrain Graph Completion Transformers

abstract: Recent work on Graph Neural Networks has demonstrated that self-supervised pretraining can further enhance performance on downstream graph, link, and node classification tasks. However, the efficacy of pretraining tasks has not been fully investigated for downstream large knowledge graph completion tasks. Using a contextualized knowledge graph embedding approach, we investigate five different pretraining signals, constructed using several graph algorithms and no external data, as well as their combination. We leverage the versatility of our Transformer-based model to explore graph structure generation pretraining tasks (i.e. path and k-hop neighborhood generation), typically inapplicable to most graph embedding methods. We further propose a new path-finding algorithm guided by information gain and find that it is the best-performing pretraining task across three downstream knowledge graph completion datasets. While using our new path-finding algorithm as a pretraining signal provides 2-3% MRR improvements, we show that pretraining on all signals together gives the best knowledge graph completion results. In a multitask setting that combines all pretraining tasks, our method surpasses the latest and strong performing knowledge graph embedding methods on all metrics for FB15K-237, on MRR and Hit@1 for WN18RRand on MRR and hit@10 for JF17K (a knowledge hypergraph dataset).


title: Communication-Efficient Adam-Type Algorithms for Distributed Data Mining

abstract: Distributed data mining is an emerging research topic to effectively and efficiently address hard data mining tasks using big data, which are partitioned and computed on different worker nodes, instead of one centralized server. Nevertheless, distributed learning methods often suffer from the communication bottleneck when the network bandwidth is limited or the size of model is large. To solve this critical issue, many gradient compression methods have been proposed recently to reduce the communication cost for multiple optimization algorithms. However, the current applications of gradient compression to adaptive gradient method, which is widely adopted because of its excellent performance to train DNNs, do not achieve the same ideal compression rate or convergence rate as Sketched-SGD. To address this limitation, in this paper, we propose a class of novel distributed Adam-type algorithms (\emph{i.e.}, SketchedAMSGrad) utilizing sketching, which is a promising compression technique that reduces the communication cost from $O(d)$ to $O(\log(d))$ where $d$ is the parameter dimension. In our theoretical analysis, we prove that our new algorithm achieves a fast convergence rate of $O(\frac{1}{\sqrt{nT}} + \frac{1}{(k/d)^2 T})$ with the communication cost of $O(k \log(d))$ at each iteration. Compared with single-machine AMSGrad, our algorithm can achieve the linear speedup with respect to the number of workers $n$. The experimental results on training various DNNs in distributed paradigm validate the efficiency of our algorithms.


title: Controlling Bias Exposure for Fair Interpretable Predictions

abstract: Recent work on reducing bias in NLP models usually focuses on protecting or isolating information related to a sensitive attribute (like gender or race). However, when sensitive information is semantically entangled with the task information of the input, e.g., gender information is predictive for a profession, a fair trade-off between task performance and bias mitigation is difficult to achieve. Existing approaches perform this trade-off by eliminating bias information from the latent space, lacking control over how much bias is necessarily required to be removed. We argue that a favorable debiasing method should use sensitive information 'fairly', rather than blindly eliminating it (Caliskan et al., 2017; Sun et al., 2019; Bogen et al., 2020). In this work, we provide a novel debiasing algorithm by adjusting the predictive model's belief to (1) ignore the sensitive information if it is not useful for the task; (2) use sensitive information minimally as necessary for the prediction (while also incurring a penalty). Experimental results on two text classification tasks (influenced by gender) and an open-ended generation task (influenced by race) indicate that our model achieves a desirable trade-off between debiasing and task performance along with producing debiased rationales as evidence.


title: Estimation of High-Dimensional Markov-Switching VAR Models with an Approximate EM Algorithm

abstract: Regime shifts in high-dimensional time series arise naturally in many applications, from neuroimaging to finance. This problem has received considerable attention in low-dimensional settings, with both Bayesian and frequentist methods used extensively for parameter estimation. The EM algorithm is a particularly popular strategy for parameter estimation in low-dimensional settings, although the statistical properties of the resulting estimates have not been well understood. Furthermore, its extension to high-dimensional time series has proved challenging. To overcome these challenges, in this paper we propose an approximate EM algorithm for Markov-switching VAR models that leads to efficient computation and also facilitates the investigation of asymptotic properties of the resulting parameter estimates. We establish the consistency of the proposed EM algorithm in high dimensions and investigate its performance via simulation studies.


title: Bayesian estimation of the autocovariance of a model error in time series

abstract: Autocovariance of the error term in a time series model plays a key role in the estimation and inference for the model that it belongs to. Typically, some arbitrary parametric structure is assumed upon the error to simplify the estimation, which inevitably introduces potential model-misspecification. We thus conduct nonparametric estimation of it. To avoid the difficult bandwidth selection issue under the traditional nonparametric truncation approach, this paper conducts the Bayesian estimation of its spectral density in a frequency domain. To this end, we consider two cases: fixed error variance and time-varying one. Each approach is taken to estimate the spectral density of the autocovariance and the model parameters. The methodology is applied to exchange rate forecasting and proves to compete favorably against some benchmark models, including the random walk without drift.


title: Semiclassical geometrodynamics of homogeneous cosmology

abstract: We study the classical-quantum (CQ) hybrid dynamics of homogeneous cosmology from a Hamiltonian perspective where the classical gravitational phase space variables and matter state evolve self-consistently with full backreaction. We compare numerically the classical and CQ dynamics for isotropic and anisotropic models, including quantum scalar-field induced corrections to the Kasner exponents. Our results indicate that full backreaction effects leave traces at late times in cosmological evolution; in particular, the scalar energy density at late times provides a potential contribution to dark energy. We also show that the CQ equations admit exact static solutions for the isotropic, and the anisotropic Bianchi IX universes with the scalar field in a stationary state.


title: Wave propagation dynamics inside a complex scattering medium by the temporal control of backscattered waves

abstract: Shaping the wavefront of an incident wave to a complex scattering medium has demonstrated interesting possibilities, such as sub-diffraction wave focusing and enhancing light energy delivery. However, wavefront shaping has mainly been based on the control of transmitted waves that are inaccessible in most realistic applications. Here, we investigate the effect of maximizing the backscattered waves at a specific flight time on wave propagation dynamics and energy transport. We find both experimentally and numerically that the maximization at a short flight time focuses waves on the particles constituting the scattering medium, leading to the attenuation of the wave transport. On the contrary, maximization at a long flight time induces constructive wave interference inside the medium and thus enhances wave transport. We provide a theoretical model explaining this interesting transition behavior based on wave correlation. Our study provides a fundamental understanding of the effect of wave control on internal wave dynamics.


title: The homogeneity of chemical abundances in H II regions of the Magellanic Clouds

abstract: We use very deep spectra obtained with the Ultraviolet-Visual Echelle Spectrograph at the Very Large Telescope to derive physical conditions and chemical abundances of four H II regions of the Large Magellanic Cloud (LMC) and four H II regions of the Small Magellanic Cloud (SMC). The observations cover the spectral range 3100-10400 \A with a spectral resolution of $\Delta\lambda\ge\lambda/11600$, and we measure 95-225 emission lines in each object. We derive ionic and total abundances of O, N, S, Ne, Ar, Cl, and Fe using collisionally excited lines. We find average values of $12+\log(\mbox{O/H})=8.37$ in the LMC and $8.01$ in the SMC, with standard deviations of $\sigma=0.03$ and 0.02~dex, respectively. The S/O, Ne/O, Ar/O, and Cl/O abundance ratios are very similar in both clouds, with $\sigma=0.02$-0.03~dex, which indicates that the chemical elements are well mixed in the interstellar medium of each galaxy. The LMC is enhanced in N/O by $\sim0.20$~dex with respect to the SMC, and the dispersions in N/O, $\sigma=0.05$~dex in each cloud, are larger than those found for the other elements. The derived standard deviations would be much larger for all the abundance ratios, up to 0.20~dex for N/O, if previous spectra of these objects were used to perform the analysis. Finally, we find a wide range of iron depletions in both clouds, with more than 90 per cent of the iron atoms deposited onto dust grains in most objects.


title: Distributed Computation for the Non-metric Data Placement Problem using Glauber Dynamics and Auctions

abstract: We consider the non-metric data placement problem and develop distributed algorithms for computing or approximating its optimal integral solution. We first show that the non-metric data placement problem is inapproximable up to a logarithmic factor. We then provide a game-theoretic decomposition of the objective function and show that natural Glauber dynamics in which players update their resources with probability proportional to the utility they receive from caching those resources will converge to an optimal global solution for a sufficiently large noise parameter. In particular, we establish the polynomial mixing time of the Glauber dynamics for a certain range of noise parameters. Finally, we provide another auction-based distributed algorithm, which allows us to approximate the optimal global solution with a performance guarantee that depends on the ratio of the revenue vs. social welfare obtained from the underlying auction. Our results provide the first distributed computation algorithms for the non-metric data placement problem.


title: Exploiting volumetric wave correlation for enhanced depth imaging in scattering medium

abstract: Imaging an object embedded within a scattering medium requires the correction of complex sample-induced wave distortions. Existing approaches have been designed to resolve them by optimizing signal waves recorded in each 2D image. Here, we present a volumetric image reconstruction framework that merges two fundamental degrees of freedom, the wavelength and propagation angles of light waves, based on the object momentum conservation principle. On this basis, we propose methods for exploiting the correlation of signal waves from volumetric images to better cope with multiple scattering. By constructing experimental systems scanning both wavelength and illumination angle of the light source, we demonstrated a 32-fold increase in the use of signal waves compared with that of existing 2D-based approaches and achieved ultrahigh volumetric resolution (lateral resolution: 0.41 um, axial resolution: 0.60 um) even within complex scattering medium owing to the optimal coherent use of the extremely broad spectral bandwidth (225 nm).


title: Polycentric Clustering and Structural Regularization for Source-free Unsupervised Domain Adaptation

abstract: Source-Free Domain Adaptation (SFDA) aims to solve the domain adaptation problem by transferring the knowledge learned from a pre-trained source model to an unseen target domain. Most existing methods assign pseudo-labels to the target data by generating feature prototypes. However, due to the discrepancy in the data distribution between the source domain and the target domain and category imbalance in the target domain, there are severe class biases in the generated feature prototypes and noisy pseudo-labels. Besides, the data structure of the target domain is often ignored, which is crucial for clustering. In this paper, a novel framework named PCSR is proposed to tackle SFDA via a novel intra-class Polycentric Clustering and Structural Regularization strategy. Firstly, an inter-class balanced sampling strategy is proposed to generate representative feature prototypes for each class. Furthermore, k-means clustering is introduced to generate multiple clustering centers for each class in the target domain to obtain robust pseudo-labels. Finally, to enhance the model's generalization, structural regularization is introduced for the target domain. Extensive experiments on three UDA benchmark datasets show that our method performs better or similarly against the other state of the art methods, demonstrating our approach's superiority for visual domain adaptation problems.


title: Visible lattice points in higher dimensional random walks and biases among them

abstract: For any integers $k\geq 2$, $q\geq 1$ and any finite set $\mathcal{A}=\{{\boldsymbol{\alpha}}_1,\cdots,{\boldsymbol{\alpha}}_q\}$, where ${ \boldsymbol{\alpha}_t}=(\alpha_{t,1},\cdots,\alpha_{t,k})~(1\leq t\leq q)$ with $0<\alpha_{t,1},\cdots,\alpha_{t,k}<1$ and $\alpha_{t,1}+\cdots+\alpha_{t,k}=1$, this paper concerns the visibility of lattice points in the type-$\mathcal{A}$ random walk on the lattice $\mathbb{Z}^k$. We show that the proportion of visible lattice points on a random path of the walk is almost surely $1/\zeta(k)$, where $\zeta(s)$ is the Riemann zeta-function, and we also consider consecutive visibility of lattice points in the type-$\mathcal{A}$ random walk and give the proportion of the corresponding visible steps. Moreover, we find a new phenomenon that visible steps in both of the above cases are not evenly distributed. Our proof relies on tools from probability theory and analytic number theory.


title: Learning Algorithms in Static Analysis of Web Applications

abstract: Web applications are distributed applications, they are programs that run on more than one computer and communicate through a network or server. This very distributed nature of web applications, combined with the scale and sheer complexity of modern software systems complicate manual security auditing, while also creating a huge attack surface of potential hackers. These factors are making automated analysis a necessity. Static Application Security Testing (SAST) is a method devised to automatically analyze application source code of large code bases without compiling it, and design conditions that are indicative of security vulnerabilities. However, the problem lies in the fact that the most widely used Static Application Security Testing Tools often yield unreliable results, owing to the false positive classification of vulnerabilities grossly outnumbering the classification of true positive vulnerabilities. This is one of the biggest hindrances to the proliferation of SAST testing, which leaves the user to review hundreds, if not thousands, of potential warnings, and classify them as either actionable or spurious. We try to minimize the problem of false positives by introducing a technique to filter the output of SAST tools. The aim of the project is to apply learning algorithms to the output by analyzing the true and false positives classified by OWASP Benchmark, and eliminate, or reduce the number of false positives presented to the user of the SAST Tool.


title: Synthetic-to-real Composite Semantic Segmentation in Additive Manufacturing

abstract: The application of computer vision and machine learning methods in the field of additive manufacturing (AM) for semantic segmentation of the structural elements of 3-D printed products will improve real-time failure analysis systems and can potentially reduce the number of defects by enabling in situ corrections. This work demonstrates the possibilities of using physics-based rendering for labeled image dataset generation, as well as image-to-image translation capabilities to improve the accuracy of real image segmentation for AM systems. Multi-class semantic segmentation experiments were carried out based on the U-Net model and cycle generative adversarial network. The test results demonstrated the capacity of detecting such structural elements of 3-D printed parts as a top layer, infill, shell, and support. A basis for further segmentation system enhancement by utilizing image-to-image style transfer and domain adaptation technologies was also developed. The results indicate that using style transfer as a precursor to domain adaptation can significantly improve real 3-D printing image segmentation in situations where a model trained on synthetic data is the only tool available. The mean intersection over union (mIoU) scores for synthetic test datasets included 94.90% for the entire 3-D printed part, 73.33% for the top layer, 78.93% for the infill, 55.31% for the shell, and 69.45% for supports.


title: Query Rewriting for Effective Misinformation Discovery

abstract: We propose a novel system to help fact-checkers formulate search queries for known misinformation claims and effectively search across multiple social media platforms. We introduce an adaptable rewriting strategy, where editing actions for queries containing claims (e.g., swap a word with its synonym; change verb tense into present simple) are automatically learned through offline reinforcement learning. Our model uses a decision transformer to learn a sequence of editing actions that maximizes query retrieval metrics such as mean average precision. We conduct a series of experiments showing that our query rewriting system achieves a relative increase in the effectiveness of the queries of up to 42%, while producing editing action sequences that are human interpretable.


title: Transparency Helps Reveal When Language Models Learn Meaning

abstract: Many current NLP systems are built from language models trained to optimize unsupervised objectives on large amounts of raw text. Under what conditions might such a procedure acquire meaning? Our systematic experiments with synthetic data reveal that, with languages where all expressions have context-independent denotations (i.e., languages with strong transparency), both autoregressive and masked language models successfully learn to emulate semantic relations between expressions. However, when denotations are changed to be context-dependent with the language otherwise unmodified, this ability degrades. Turning to natural language, our experiments with a specific phenomenon -- referential opacity -- add to the growing body of evidence that current language models do not represent natural language semantics well. We show this failure relates to the context-dependent nature of natural language form-meaning mappings.


title: StyLEx: Explaining Style Using Human Lexical Annotations

abstract: Large pre-trained language models have achieved impressive results on various style classification tasks, but they often learn spurious domain-specific words to make predictions (Hayati et al., 2021). While human explanation highlights stylistic tokens as important features for this task, we observe that model explanations often do not align with them. To tackle this issue, we introduce StyLEx, a model that learns from human-annotated explanations of stylistic features and jointly learns to perform the task and predict these features as model explanations. Our experiments show that StyLEx can provide human-like stylistic lexical explanations without sacrificing the performance of sentence-level style prediction on both in-domain and out-of-domain datasets. Explanations from StyLEx show significant improvements in explanation metrics (sufficiency, plausibility) and when evaluated with human annotations. They are also more understandable by human judges compared to the widely-used saliency-based explanation baseline.


title: Measurement of 2x2 LoS MIMO Terahertz Channel

abstract: This paper examines the performance of a 2x2 Line of Sight (LoS) Multiple Input Multiple Output (MIMO) channel at three terahertz frequencies-340 GHz, 410 Ghz, and 460 GHz. While theoretical models predict very high channel capacities, we observe lower capacity which is explained by asymmetric transmit-to-receive signal strengths as well as due to signal attenuation over longer distances. Overall, however, we note that at 460 Ghz, channel capacity of higher than 12 bps/hz is possible even at sub-optimal inter-antenna spacings (for different distances). An important observation is also that we need to maintain appropriate receive signal levels at receive antennas in order to improve capacity.


title: "John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility

abstract: In current NLP research, large-scale language models and their abilities are widely being discussed. Some recent works have also found notable failures of these models. Often these failure examples involve complex reasoning abilities. This work focuses on a simple commonsense ability, reasoning about when an action (or its effect) is feasible. To this end, we introduce FeasibilityQA, a question-answering dataset involving binary classification (BCQ) and multi-choice multi-correct questions (MCQ) that test understanding of feasibility. We show that even state-of-the-art models such as GPT-3, GPT-2, and T5 struggle to answer the feasibility questions correctly. Specifically, on MCQ and BCQ questions, GPT-3 achieves an accuracy of just (19%, 62%) and (25%, 64%) in zero-shot and few-shot settings, respectively. We also evaluate models by providing relevant knowledge statements required to answer the question. We find that the additional knowledge leads to a 7% gain in performance, but the overall performance still remains low. These results make one wonder how much commonsense knowledge about action feasibility is encoded in state-of-the-art models and how well they can reason about it.


title: Robust Candidate Generation for Entity Linking on Short Social Media Texts

abstract: Entity Linking (EL) is the gateway into Knowledge Bases. Recent advances in EL utilize dense retrieval approaches for Candidate Generation, which addresses some of the shortcomings of the Lookup based approach of matching NER mentions against pre-computed dictionaries. In this work, we show that in the domain of Tweets, such methods suffer as users often include informal spelling, limited context, and lack of specificity, among other issues. We investigate these challenges on a large and recent Tweets benchmark for EL, empirically evaluate lookup and dense retrieval approaches, and demonstrate a hybrid solution using long contextual representation from Wikipedia is necessary to achieve considerable gains over previous work, achieving 0.93 recall.


title: Probabilistic Framework of Howard's Policy Iteration: BML Evaluation and Robust Convergence Analysis

abstract: This paper aims to build a probabilistic framework for Howard's policy iteration algorithm using the language of forward-backward stochastic differential equations (FBSDEs). As opposed to conventional formulations based on partial differential equations, our FBSDE-based formulation can be easily implemented by optimizing criteria over sample data, and is therefore less sensitive to the state dimension. In particular, both on-policy and off-policy evaluation methods are discussed by constructing different FBSDEs. The backward-measurability-loss (BML) criterion is then proposed for solving these equations. By choosing specific weight functions in the proposed criterion, we can recover the popular Deep BSDE method or the martingale approach for BSDEs. The convergence results are established under both ideal and practical conditions, depending on whether the optimization criteria are decreased to zero. In the ideal case, we prove that the policy sequences produced by proposed FBSDE-based algorithms and the standard policy iteration have the same performance, and thus have the same convergence rate. In the practical case, the proposed algorithm is still proved to converge robustly under mild assumptions on optimization errors.


title: SQA3D: Situated Question Answering in 3D Scenes

abstract: We propose a new task to benchmark scene understanding of embodied agents: Situated Question Answering in 3D Scenes (SQA3D). Given a scene context (e.g., 3D scan), SQA3D requires the tested agent to first understand its situation (position, orientation, etc.) in the 3D scene as described by text, then reason about its surrounding environment and answer a question under that situation. Based upon 650 scenes from ScanNet, we provide a dataset centered around 6.8k unique situations, along with 20.4k descriptions and 33.4k diverse reasoning questions for these situations. These questions examine a wide spectrum of reasoning capabilities for an intelligent agent, ranging from spatial relation comprehension to commonsense understanding, navigation, and multi-hop reasoning. SQA3D imposes a significant challenge to current multi-modal especially 3D reasoning models. We evaluate various state-of-the-art approaches and find that the best one only achieves an overall score of 47.20%, while amateur human participants can reach 90.06%. We believe SQA3D could facilitate future embodied AI research with stronger situation understanding and reasoning capability.


title: Latent Temporal Flows for Multivariate Analysis of Wearables Data

abstract: Increased use of sensor signals from wearable devices as rich sources of physiological data has sparked growing interest in developing health monitoring systems to identify changes in an individual's health profile. Indeed, machine learning models for sensor signals have enabled a diverse range of healthcare related applications including early detection of abnormalities, fertility tracking, and adverse drug effect prediction. However, these models can fail to account for the dependent high-dimensional nature of the underlying sensor signals. In this paper, we introduce Latent Temporal Flows, a method for multivariate time-series modeling tailored to this setting. We assume that a set of sequences is generated from a multivariate probabilistic model of an unobserved time-varying low-dimensional latent vector. Latent Temporal Flows simultaneously recovers a transformation of the observed sequences into lower-dimensional latent representations via deep autoencoder mappings, and estimates a temporally-conditioned probabilistic model via normalizing flows. Using data from the Apple Heart and Movement Study (AH&MS), we illustrate promising forecasting performance on these challenging signals. Additionally, by analyzing two and three dimensional representations learned by our model, we show that we can identify participants' $\text{VO}_2\text{max}$, a main indicator and summary of cardio-respiratory fitness, using only lower-level signals. Finally, we show that the proposed method consistently outperforms the state-of-the-art in multi-step forecasting benchmarks (achieving at least a $10\%$ performance improvement) on several real-world datasets, while enjoying increased computational efficiency.


title: An interpretation of TRiSK-type schemes from a discrete exterior calculus perspective

abstract: TRiSK-type numerical schemes are widely used in both atmospheric and oceanic dynamical cores, due to their discrete analogues of important properties such as energy conservation and steady geostrophic modes. In this work, we show that these numerical methods are best understood as a discrete exterior calculus (DEC) scheme applied to a Hamiltonian formulation of the rotating shallow water equations based on split exterior calculus. This comprehensive description of the differential geometric underpinnings of TRiSK-type schemes completes the one started in \cite{Thuburn2012,Eldred2017}, and provides a new understanding of certain operators in TRiSK-type schemes as discrete wedge products and topological pairings from split exterior calculus. All known TRiSK-type schemes in the literature are shown to fit inside this general framework, by identifying the (implicit) choices made for various DEC operators by the different schemes. In doing so, unexplored choices and combinations are identified that might offer the possibility of fixing known issues with TRiSK-type schemes such as operator accuracy and Hollingsworth instability.


title: Low-cost, Low-loss, Ultra-wideband Compact Feed for Interferometric Radio Telescopes

abstract: We have developed, built, and tested a new feed design for interferometric radio telescopes with "large-$N$, small-$D$" designs. Those arrays require low-cost and low-complexity feeds for mass production on reasonable timescales and budgets, and also require those feeds to be compact to minimize obstruction of the dishes, along with having ultra wide bands of operation for most current and future science goals. The feed presented in this paper modifies the exponentially tapered slot antenna (Vivaldi) and quad-ridged flared horn antenna designs by having an oversized backshort, a novel method of maintaining a small size that is well-suited for deeper dishes ($f/D\leq 0.25$). It is made of laser cut aluminum and printed circuit boards, such that it is inexpensive ($\lesssim$ 75 USD per feed in large-scale production) and quick to build; it has a 5:1 frequency ratio, and its size is approximately a third of its longest operating wavelength. We present the science and engineering constraints that went into design decisions, the development and optimization process, and the simulated performance. A version of this feed design was optimized and built for the Canadian Hydrogen Observatory and Radio-transient Detector (CHORD) prototypes. When simulated on CHORD's very deep dishes ($f/D=0.21$) and with CHORD's custom first stage amplifiers, the on-sky system temperature $T_\mathrm{sys}$ of the complete receiving system from dish to digitizer remains below 30 K over most of the 0.3-1.5 GHz band, and maintains an aperture efficiency $\eta_\mathrm{A}$ between 0.4 and 0.6. The entire receiving chain operates at ambient temperature. The feed is designed to slightly under-illuminate the CHORD dishes, in order to minimize coupling between array elements and spillover.


title: On the underestimation of dust mass in protoplanetary disks: Effects of disk structure and dust properties

abstract: The total amount of dust grains in protoplanetary disks is one of the key properties that characterize the potential for planet formation. With (sub-)millimeter flux measurements, literature studies usually derive the dust mass using an analytic form under the assumption of optically thin emission, which may lead to substantial underestimation. In this work, we conduct a parameter study with the goal of investigating the effects of disk structure and dust properties on the underestimation through self-consistent radiative transfer models. Different dust models, scattering modes and approaches for dust settling are considered and compared. The influences of disk substructures, such as rings and crescents, on the mass derivation are investigated as well. The results indicate that the traditional analytic method can underestimate the mass by a factor of a few to hundreds, depending on the optical depth along the line of sight set mainly by the true dust mass, disk size and inclination. As an application, we perform a detailed radiative transfer modeling of the spectral energy distribution of DoAr 33, one of the observed DSHARP disks. When the DSHARP dust opacities are adopted, the most probable dust mass returned from the Bayesian analysis is roughly 7 times higher than the value given by the analytic calculation. Our study demonstrates that estimating disk dust masses from radiative transfer modeling is one solution for alleviating the problem of insufficient mass for planet formation raised in the ALMA era.


title: Identification of a boundary obstacle in a Stokes fluid with Dirichlet--Navier boundary conditions: external measurements

abstract: The problem of identifying an obstruction into a fluid duct has several applications, one of them, for example in medicine the presence of Stenosis in coronary vessels is a life threatening disease. In this paper, we formulate a continuous setting and study from a numerical perspective the inverse problem of identifying an obstruction contained in a 2D duct where a Stokes flow hits on the boundary (Dirichlet and Navier--slip boundary conditions), generating an acoustic wave. To be precise, by using acoustic wave measurements at certain points on the exterior of the duct, we can identify the location, extension and height of the obstruction. Thus, our framework constitutes an external approach to solving this obstacle-inverse problem. Synthetic examples are used to verify the effectiveness of the proposed numerical formulation.


title: Real-time computational powered landing guidance using convex optimization and neural networks

abstract: Computational guidance is an emerging and accelerating trend in aerospace guidance and control. Combining machine learning and convex optimization, this paper presents a real-time computational guidance method for the 6-degrees-of-freedom powered landing guidance problem. The powered landing guidance problem is formulated as an optimal control problem, which is then transformed into a convex optimization problem. Instead of brutally using the neural networks as the controller, we use neural networks to improve the state-of-the-art sequential convex programming (SCP) algorithm. Based on the deep neural network, an initial trajectory generator is designed to provide a satisfactory initial guess for the SCP algorithm. Benefitting from designing the initial trajectory generator as a sequence model predictor, the proposed data-driven SCP architecture is capable of improving the performance of any state-of-the-art SCP algorithm in various applications, not just powered landing guidance. The simulation results show that the proposed method can precisely guide the vehicle to the landing site. Moreover, through Monte Carlo tests, the proposed method can averagely save 40.8% of the computation time compared with the SCP method, while ensuring higher terminal states accuracy. The proposed computational guidance scheme is suitable for real-time applications.


title: InFIP: An Explainable DNN Intellectual Property Protection Method based on Intrinsic Features

abstract: Intellectual property (IP) protection for Deep Neural Networks (DNNs) has raised serious concerns in recent years. Most existing works embed watermarks in the DNN model for IP protection, which need to modify the model and lack of interpretability. In this paper, for the first time, we propose an interpretable intellectual property protection method for DNN based on explainable artificial intelligence. Compared with existing works, the proposed method does not modify the DNN model, and the decision of the ownership verification is interpretable. We extract the intrinsic features of the DNN model by using Deep Taylor Decomposition. Since the intrinsic feature is composed of unique interpretation of the model's decision, the intrinsic feature can be regarded as fingerprint of the model. If the fingerprint of a suspected model is the same as the original model, the suspected model is considered as a pirated model. Experimental results demonstrate that the fingerprints can be successfully used to verify the ownership of the model and the test accuracy of the model is not affected. Furthermore, the proposed method is robust to fine-tuning attack, pruning attack, watermark overwriting attack, and adaptive attack.


title: Cargo Ecosystem Dependency-Vulnerability Knowledge Graph Construction and Vulnerability Propagation Study

abstract: Currently, little is known about the structure of the Cargo ecosystem and the potential for vulnerability propagation. Many empirical studies generalize third-party dependency governance strategies from a single software ecosystem to other ecosystems but ignore the differences in the technical structures of different software ecosystems, making it difficult to directly generalize security governance strategies from other ecosystems to the Cargo ecosystem. To fill the gap in this area, this paper constructs a knowledge graph of dependency vulnerabilities for the Cargo ecosystem using techniques related to knowledge graphs to address this challenge. This paper is the first large-scale empirical study in a related research area to address vulnerability propagation in the Cargo ecosystem. This paper proposes a dependency-vulnerability knowledge graph parsing algorithm to determine the vulnerability propagation path and propagation range and empirically studies the characteristics of vulnerabilities in the Cargo ecosystem, the propagation range, and the factors that cause vulnerability propagation. Our research has found that the Cargo ecosystem's security vulnerabilities are primarily memory-related. 18% of the libraries affected by the vulnerability is still affected by the vulnerability in the latest version of the library. The number of versions affected by the propagation of the vulnerabilities is 19.78% in the entire Cargo ecosystem. This paper looks at the characteristics and propagation factors triggering vulnerabilities in the Cargo ecosystem. It provides some practical resolution strategies for administrators of the Cargo community, developers who use Cargo to manage third-party libraries, and library owners. This paper provides new ideas for improving the overall security of the Cargo ecosystem.


title: Intravital imaging and cavitation monitoring of antivascular ultrasound in tumor microvasculature

abstract: Focused ultrasound stimulated microbubbles have been shown to be capable of inducing blood flow shutdown and necrosis in a range of tissue types in an approach termed antivascular ultrasound or mechanical ablation. In oncology, this approach has demonstrated tumor growth inhibition, and profound synergistic antitumor effects when combined with traditional platforms of chemo, radiation and immune therapies. However, the exposure schemes employed have been broad and underlying mechanisms remain unclear with fundamental questions about exposures, vessel types and sizes involved, and the nature of bubble behaviors and their acoustic emissions resulting in vascular damage, impeding the establishment of standard protocols. Here, ultrasound transmitters and receivers are integrated into a murine dorsal window chamber tumor model for intravital microscopy studies capable of real time visual and acoustic monitoring during antivascular ultrasound. Vessel type (normal and tumor affected), caliber, and viability are assessed under higher pressure conditions (1, 2, and 3 MPa), and cavitation signatures are linked to the biological effects. Vascular events occurred preferentially in tumor affected vessels with greater incidence in smaller vessels and with more severity as a function of increasing pressure. Vascular blood flow shutdown was found to be due to a combination of focal disruption events and network related flow changes. Acoustic emissions displayed elevated broadband noise and distinct sub and ultra harmonics and their associated third order peaks with increasing pressure. The observed vascular events taken collectively with identified cavitation signatures provide an improved mechanistic understanding of antivascular ultrasound at the microscale, with implications for establishing a specific treatment protocol and control platform.


title: Mutual Information Regularized Offline Reinforcement Learning

abstract: The major challenge of offline RL is the distribution shift that appears when out-of-distribution actions are queried, which makes the policy improvement direction biased by extrapolation errors. Most existing methods address this problem by penalizing the policy or value for deviating from the behavior policy during policy improvement or evaluation. In this work, we propose a novel MISA framework to approach offline RL from the perspective of Mutual Information between States and Actions in the dataset by directly constraining the policy improvement direction. MISA constructs lower bounds of mutual information parameterized by the policy and Q-values. We show that optimizing this lower bound is equivalent to maximizing the likelihood of a one-step improved policy on the offline dataset. Hence, we constrain the policy improvement direction to lie in the data manifold. The resulting algorithm simultaneously augments the policy evaluation and improvement by adding mutual information regularizations. MISA is a general framework that unifies conservative Q-learning (CQL) and behavior regularization methods (e.g., TD3+BC) as special cases. We introduce 3 different variants of MISA, and empirically demonstrate that tighter mutual information lower bound gives better offline RL performance. In addition, our extensive experiments show MISA significantly outperforms a wide range of baselines on various tasks of the D4RL benchmark,e.g., achieving 742.9 total points on gym-locomotion tasks. Our code is available at https://github.com/sail-sg/MISA.


title: Holistic Sentence Embeddings for Better Out-of-Distribution Detection

abstract: Detecting out-of-distribution (OOD) instances is significant for the safe deployment of NLP models. Among recent textual OOD detection works based on pretrained language models (PLMs), distance-based methods have shown superior performance. However, they estimate sample distance scores in the last-layer CLS embedding space and thus do not make full use of linguistic information underlying in PLMs. To address the issue, we propose to boost OOD detection by deriving more holistic sentence embeddings. On the basis of the observations that token averaging and layer combination contribute to improving OOD detection, we propose a simple embedding approach named Avg-Avg, which averages all token representations from each intermediate layer as the sentence embedding and significantly surpasses the state-of-the-art on a comprehensive suite of benchmarks by a 9.33% FAR95 margin. Furthermore, our analysis demonstrates that it indeed helps preserve general linguistic knowledge in fine-tuned PLMs and substantially benefits detecting background shifts. The simple yet effective embedding method can be applied to fine-tuned PLMs with negligible extra costs, providing a free gain in OOD detection. Our code is available at https://github.com/lancopku/Avg-Avg.


title: AFETM: Adaptive function execution trace monitoring for fault diagnosis

abstract: The high tracking overhead, the amount of up-front effort required to selecting the trace points, and the lack of effective data analysis model are the significant barriers to the adoption of intra-component tracking for fault diagnosis today. This paper introduces a novel method for fault diagnosis by combining adaptive function level dynamic tracking, target fault injection, and graph convolutional network. In order to implement this method, we introduce techniques for (i) selecting function level trace points, (ii) constructing approximate function call tree of program when using adaptive tracking, and (iii) constructing graph convolutional network with fault injection campaign. We evaluate our method using a web service benchmark composed of Redis, Nginx, Httpd, and SQlite. The experimental results show that this method outperforms log based method, full tracking method, and Gaussian influence method in the accuracy of fault diagnosis, overhead, and performance impact on the diagnosis target.


title: A Scalable Finite Difference Method for Deep Reinforcement Learning

abstract: Several low-bandwidth distributable black-box optimization algorithms in the family of finite differences such as Evolution Strategies have recently been shown to perform nearly as well as tailored Reinforcement Learning methods in some Reinforcement Learning domains. One shortcoming of these black-box methods is that they must collect information about the structure of the return function at every update, and can often employ only information drawn from a distribution centered around the current parameters. As a result, when these algorithms are distributed across many machines, a significant portion of total runtime may be spent with many machines idle, waiting for a final return and then for an update to be calculated. In this work we introduce a novel method to use older data in finite difference algorithms, which produces a scalable algorithm that avoids significant idle time or wasted computation.


title: MetaFill: Text Infilling for Meta-Path Generation on Heterogeneous Information Networks

abstract: Heterogeneous Information Network (HIN) is essential to study complicated networks containing multiple edge types and node types. Meta-path, a sequence of node types and edge types, is the core technique to embed HINs. Since manually curating meta-paths is time-consuming, there is a pressing need to develop automated meta-path generation approaches. Existing meta-path generation approaches cannot fully exploit the rich textual information in HINs, such as node names and edge type names. To address this problem, we propose MetaFill, a text-infilling-based approach for meta-path generation. The key idea of MetaFill is to formulate meta-path identification problem as a word sequence infilling problem, which can be advanced by Pretrained Language Models (PLMs). We observed the superior performance of MetaFill against existing meta-path generation methods and graph embedding methods that do not leverage meta-paths in both link prediction and node classification on two real-world HIN datasets. We further demonstrated how MetaFill can accurately classify edges in the zero-shot setting, where existing approaches cannot generate any meta-paths. MetaFill exploits PLMs to generate meta-paths for graph embedding, opening up new avenues for language model applications in graph analysis.


title: The Surprisingly Straightforward Scene Text Removal Method With Gated Attention and Region of Interest Generation: A Comprehensive Prominent Model Analysis

abstract: Scene text removal (STR), a task of erasing text from natural scene images, has recently attracted attention as an important component of editing text or concealing private information such as ID, telephone, and license plate numbers. While there are a variety of different methods for STR actively being researched, it is difficult to evaluate superiority because previously proposed methods do not use the same standardized training/evaluation dataset. We use the same standardized training/testing dataset to evaluate the performance of several previous methods after standardized re-implementation. We also introduce a simple yet extremely effective Gated Attention (GA) and Region-of-Interest Generation (RoIG) methodology in this paper. GA uses attention to focus on the text stroke as well as the textures and colors of the surrounding regions to remove text from the input image much more precisely. RoIG is applied to focus on only the region with text instead of the entire image to train the model more efficiently. Experimental results on the benchmark dataset show that our method significantly outperforms existing state-of-the-art methods in almost all metrics with remarkably higher-quality results. Furthermore, because our model does not generate a text stroke mask explicitly, there is no need for additional refinement steps or sub-models, making our model extremely fast with fewer parameters. The dataset and code are available at this https://github.com/naver/garnet.


title: Exploring Vanilla U-Net for Lesion Segmentation from Whole-body FDG-PET/CT Scans

abstract: Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and CT-based anatomic information can contribute to better tumor segmentation results. %Computed tomography~(CT) is a popular modality to illustrate the anatomic structure of the patient. The combination of PET and CT is promising to handle this challenge by utilizing metabolic and anatomic information. In this paper, we explore the potential of U-Net for lesion segmentation in whole-body FDG-PET/CT scans from three aspects, including network architecture, data preprocessing, and data augmentation. The experimental results demonstrate that the vanilla U-Net with proper input shape can achieve satisfactory performance. Specifically, our method achieves first place in both preliminary and final leaderboards of the autoPET 2022 challenge. Our code is available at https://github.com/Yejin0111/autoPET2022_Blackbean.


title: Latent process models for functional network data

abstract: Network data are often sampled with auxiliary information or collected through the observation of a complex system over time, leading to multiple network snapshots indexed by a continuous variable. Many methods in statistical network analysis are traditionally designed for a single network, and can be applied to an aggregated network in this setting, but that approach can miss important functional structure. Here we develop an approach to estimating the expected network explicitly as a function of a continuous index, be it time or another indexing variable. We parameterize the network expectation through low dimensional latent processes, whose components we represent with a fixed, finite-dimensional functional basis. We derive a gradient descent estimation algorithm, establish theoretical guarantees for recovery of the low-dimensional structure, compare our method to competitors, and apply it to a dataset of international political interactions over time, showing our proposed method to adapt well to data, outperform competitors, and provide interpretable and meaningful results.


title: An Evolution and Eruption of the Coronal Magnetic Field through a Data-Driven MHD Simulation

abstract: We present a newly developed data-driven magnetohydrodynamics (MHD) simulation code under a zero-beta approximation based on a method proposed by Hayashi et al. 2018 and 2019. Although many data-driven MHD simulations have been developed and conducted, there are not many studies on how accurately those simulations can reproduce the phenomena observed in the solar corona. In this study, we investigated the performance of our data-driven simulation quantitatively using ground-truth data. The ground-truth data was produced by an MHD simulation in which the magnetic field is twisted by the sunspot motions. A magnetic flux rope (MFR) is created by the cancellation of the magnetic flux at the polarity inversion line due to the converging flow on the sunspot, which eventually leads the eruption of the MFR. We attempted to reproduce these dynamics using the data-driven MHD simulation. The coronal magnetic fields are driven by the electric fields, which are obtained from a time-series of the photospheric magnetic field that is extracted from the ground-truth data, on the surface. As a result, the data-driven simulation could capture the subsequent MHD processes, the twisted coronal magnetic field and formation of the MFR, and also its eruption. We report these results and compare with the ground-truth data, and discuss how to improve the accuracy and optimize numerical method.


title: Psychology-guided Controllable Story Generation

abstract: Controllable story generation is a challenging task in the field of NLP, which has attracted increasing research interest in recent years. However, most existing works generate a whole story conditioned on the appointed keywords or emotions, ignoring the psychological changes of the protagonist. Inspired by psychology theories, we introduce global psychological state chains, which include the needs and emotions of the protagonists, to help a story generation system create more controllable and well-planned stories. In this paper, we propose a Psychology-guIded Controllable Story Generation System (PICS) to generate stories that adhere to the given leading context and desired psychological state chains for the protagonist. Specifically, psychological state trackers are employed to memorize the protagonist's local psychological states to capture their inner temporal relationships. In addition, psychological state planners are adopted to gain the protagonist's global psychological states for story planning. Eventually, a psychology controller is designed to integrate the local and global psychological states into the story context representation for composing psychology-guided stories. Automatic and manual evaluations demonstrate that PICS outperforms baselines, and each part of PICS shows effectiveness for writing stories with more consistent psychological changes.


title: A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking

abstract: Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory space. Up to now, though numerous scalable GNN architectures have been proposed, we still lack a comprehensive survey and fair benchmark of this reservoir to find the rationale for designing scalable GNNs. To this end, we first systematically formulate the representative methods of large-scale graph training into several branches and further establish a fair and consistent benchmark for them by a greedy hyperparameter searching. In addition, regarding efficiency, we theoretically evaluate the time and space complexity of various branches and empirically compare them w.r.t GPU memory usage, throughput, and convergence. Furthermore, We analyze the pros and cons for various branches of scalable GNNs and then present a new ensembling training manner, named EnGCN, to address the existing issues. Our code is available at https://github.com/VITA-Group/Large_Scale_GCN_Benchmarking.


title: Practical Applications of Gaussian Process with Uncertainty Quantification and Sensitivity Analysis for Digital Twin for Accident Tolerant Fuel

abstract: The application of digital twin (DT) technology to the nuclear field is one of the challenges in the future development of nuclear energy. Possible applications of DT technology in the nuclear field are expected to be very wide: operate commercial nuclear reactors, monitor spent fuel storage and disposal facilities, and develop new nuclear systems. As U.S. Nuclear Regulatory Committee (NRC) recently announced, machine learning (ML) and artificial intelligence (AI) will be new domains in the nuclear field. Considering the data science perspective, Gaussian Process (GP) has proven to be an ML algorithm for modeling and simulation components of the digital twin framework, specifically for the accident tolerant fuel (ATF) concepts. ATF is one of the high-priority areas for both the U.S. Department of Energy (DOE) and NRC. GP's inherent treatment of lack of data, missing data, and data inconsistencies (noisy/erroneous data) present in the ATF concepts make it an attractive machine learning algorithm for implementation in the DT framework. This chapter focuses on the practical demonstration of GP and its applicability to the DT framework for predicting ATF.


title: On the size of maximal binary codes with 2, 3, and 4 distances

abstract: We address the maximum size of binary codes and binary constant weight codes with few distances. Previous works established a number of bounds for these quantities as well as the exact values for a range of small code lengths. As our main results, we determine the exact size of maximal binary codes with two distances for all lengths $n\ge 6$ as well as the exact size of maximal binary constant weight codes with 2,3, and 4 distances for several values of the weight and for all but small lengths.


title: Distributed Emergency Frequency Control Considering Transient Stability Constraints in Multi-Infeed Hybrid AC-DC System

abstract: Due to possible emergency faults and frequency regulation reserve shortage in the multi-infeed hybrid AC-DC (MIDC) system, the emergency frequency control (EFC) with LCC-HVDC systems participating is important for system frequency stability. Nevertheless, the existing decentralized EFC strategies cannot guarantee the transient stability constraints of lines and cannot meet the frequency restoration requirement. To fill this gap, this paper proposes a complementary distributed EFC strategy. By selecting the semi-distributed or fully-distributed control law according to the state of AC system control center, the proposed distributed EFC can improve the control performance with a normal control center and enhance the control reliability in case of control center failure. Then, to derive the semi-distributed and fully-distributed control laws, a general design method is proposed by formulating an optimal EFC problem. Both of these two control laws can guarantee transient stability constraints, restore system frequency and achieve the defined optimal control objective. Moreover, the optimality of the closed-loop equilibrium is proven, and a Lyapunov analysis shows the asymptotic stability of the closed-loop system with the discontinuous control dynamics. A case study verifies the effectiveness of the proposed distributed EFC strategy.


title: Variable Importance Based Interaction Modeling with an Application on Initial Spread of COVID-19 in China

abstract: Interaction selection for linear regression models with both continuous and categorical predictors is useful in many fields of modern science, yet very challenging when the number of predictors is relatively large. Existing interaction selection methods focus on finding one optimal model. While attractive properties such as consistency and oracle property have been well established for such methods, they actually may perform poorly in terms of stability for high-dimensional data, and they do not typically deal with categorical predictors. In this paper, we introduce a variable importance based interaction modeling (VIBIM) procedure for learning interactions in a linear regression model with both continuous and categorical predictors. It delivers multiple strong candidate models with high stability and interpretability. Simulation studies demonstrate its good finite sample performance. We apply the VIBIM procedure to a Corona Virus Disease 2019 (COVID-19) data used in Tian et al. (2020) and measure the effects of relevant factors, including transmission control measures on the spread of COVID-19. We show that the VIBIM approach leads to better models in terms of interpretability, stability, reliability and prediction.


title: Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence tasks

abstract: Sequence-to-Sequence (seq2seq) tasks transcribe the input sequence to a target sequence. The Connectionist Temporal Classification (CTC) criterion is widely used in multiple seq2seq tasks. Besides predicting the target sequence, a side product of CTC is to predict the alignment, which is the most probable input-long sequence that specifies a hard aligning relationship between the input and target units. As there are multiple potential aligning sequences (called paths) that are equally considered in CTC formulation, the choice of which path will be most probable and become the predicted alignment is always uncertain. In addition, it is usually observed that the alignment predicted by vanilla CTC will drift compared with its reference and rarely provides practical functionalities. Thus, the motivation of this work is to make the CTC alignment prediction controllable and thus equip CTC with extra functionalities. The Bayes risk CTC (BRCTC) criterion is then proposed in this work, in which a customizable Bayes risk function is adopted to enforce the desired characteristics of the predicted alignment. With the risk function, the BRCTC is a general framework to adopt some customizable preference over the paths in order to concentrate the posterior into a particular subset of the paths. In applications, we explore one particular preference which yields models with the down-sampling ability and reduced inference costs. By using BRCTC with another preference for early emissions, we obtain an improved performance-latency trade-off for online models. Experimentally, the proposed BRCTC reduces the inference cost of offline models by up to 47% without performance degradation and cuts down the overall latency of online systems to an unseen level.


title: ToupleGDD: A Fine-Designed Solution of Influence Maximization by Deep Reinforcement Learning

abstract: Aiming at selecting a small subset of nodes with maximum influence on networks, the Influence Maximization (IM) problem has been extensively studied. Since it is #P-hard to compute the influence spread given a seed set, the state-of-the-art methods, including heuristic and approximation algorithms, faced with great difficulties such as theoretical guarantee, time efficiency, generalization, etc. This makes it unable to adapt to large-scale networks and more complex applications. On the other side, with the latest achievements of Deep Reinforcement Learning (DRL) in artificial intelligence and other fields, lots of works have been focused on exploiting DRL to solve combinatorial optimization problems. Inspired by this, we propose a novel end-to-end DRL framework, ToupleGDD, to address the IM problem in this paper, which incorporates three coupled graph neural networks for network embedding and double deep Q-networks for parameters learning. Previous efforts to solve IM problem with DRL trained their models on subgraphs of the whole network, and then tested on the whole graph, which makes the performance of their models unstable among different networks. However, our model is trained on several small randomly generated graphs with a small budget, and tested on completely different networks under various large budgets, which can obtain results very close to IMM and better results than OPIM-C on several datasets, and shows strong generalization ability. Finally, we conduct a large number of experiments on synthetic and realistic datasets, and experimental results prove the effectiveness and superiority of our model.


title: Thermocapillary Convection in Superimposed Layers of Self-Rewetting Fluids: Analytical and Lattice Boltzmann Computational Study

abstract: Self-rewetting fluids (SRFs), such as aqueous solutions of long-chain alcohols, exhibit anomalous quadratic dependence of surface tension on temperature having a minimum and with a positive gradient. When compared to the normal fluids (NFs), the SRFs can be associated with significantly modified interfacial dynamics, which have recently been exploited to enhance flow and thermal transport in various applications (e.g., microgravity and microscale transport systems). In this work, first, we develop a new analytical solution of thermocapillary convection in superimposed two SRF layers confined within a microchannel that is sinusoidally heated on one side and maintained at a uniform temperature on the other side under the creeping flow regime. Then, a robust central moment lattice Boltzmann method using the Allen-Cahn equation for interface tracking, two-fluid motion, and the energy transport for numerical simulations of SRFs is constructed. The analytical and computational techniques are generally shown to be in good quantitative agreement with one another. Moreover, the effect of the various characteristic parameters on the magnitude and the distribution thermocapillary-driven motion is studied. The thermocapillary flow patterns in SRFs are shown to be strikingly different when compared to the NFs: For otherwise the same conditions, the SRFs result in eight periodic counterrotating thermocapillary convection rolls, while the NFs exhibit only four such vortices. Moreover, the direction of the circulating fluid motion in such vortical structures for the SRFs is found to be towards the hotter zones on the interfaces, which is opposite to that in NFs. By tuning the sensitivity coefficients of the surface tension on temperature, it is shown that the magnitude as well the overall thermocapillary flow patterns can be significantly manipulated.


title: Liquid Welfare Guarantees for No-Regret Learning in Sequential Budgeted Auctions

abstract: We study the liquid welfare in sequential first-price auctions with budget-limited buyers. We focus on first-price auctions, which are increasingly commonly used in many settings, and consider liquid welfare, a natural and well-studied generalization of social welfare for buyers with budgets. We use a behavioral model for the buyers, assuming a learning style guarantee: the resulting utility of each buyer is within a $\gamma$ factor (where $\gamma\ge 1$) of the utility achievable by shading her value with the same factor at each round. Under this assumption, we show a $\gamma+1/2+O(1/\gamma)$ price of anarchy for liquid welfare assuming buyers have additive valuations. This positive result is in contrast to sequential second-price auctions, where even with $\gamma=1$, the resulting liquid welfare can be arbitrarily smaller than the maximum liquid welfare. We prove a lower bound of $\gamma$ on the liquid welfare loss under the above assumption in first-price auctions, making our bound asymptotically tight. For the case when $\gamma = 1$ our theorem implies a price of anarchy upper bound that is about $2.41$; we show a lower bound of $2$ for that case. We also give a learning algorithm that the players can use to achieve the guarantee needed for our liquid welfare result. Our algorithm achieves utility within a $\gamma=O(1)$ factor of the optimal utility even when a buyer's values and the bids of the other buyers are chosen adversarially, assuming the buyer's budget grows linearly with time. The competitiveness guarantee of the learning algorithm deteriorates somewhat as the budget grows slower than linearly with time. Finally, we extend our liquid welfare results for the case where buyers have submodular valuations over the set of items they win across iterations with a slightly worse price of anarchy bound of $\gamma+1+O(1/\gamma)$ compared to the guarantee for the additive case.


title: STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition

abstract: In action recognition, although the combination of spatio-temporal videos and skeleton features can improve the recognition performance, a separate model and balancing feature representation for cross-modal data are required. To solve these problems, we propose Spatio-TemporAl cRoss (STAR)-transformer, which can effectively represent two cross-modal features as a recognizable vector. First, from the input video and skeleton sequence, video frames are output as global grid tokens and skeletons are output as joint map tokens, respectively. These tokens are then aggregated into multi-class tokens and input into STAR-transformer. The STAR-transformer encoder layer consists of a full self-attention (FAttn) module and a proposed zigzag spatio-temporal attention (ZAttn) module. Similarly, the continuous decoder consists of a FAttn module and a proposed binary spatio-temporal attention (BAttn) module. STAR-transformer learns an efficient multi-feature representation of the spatio-temporal features by properly arranging pairings of the FAttn, ZAttn, and BAttn modules. Experimental results on the Penn-Action, NTU RGB+D 60, and 120 datasets show that the proposed method achieves a promising improvement in performance in comparison to previous state-of-the-art methods.