title: Unpacking Large Language Models with Conceptual Consistency

abstract: If a Large Language Model (LLM) answers "yes" to the question "Are mountains tall?" then does it know what a mountain is? Can you rely on it responding correctly or incorrectly to other questions about mountains? The success of Large Language Models (LLMs) indicates they are increasingly able to answer queries like these accurately, but that ability does not necessarily imply a general understanding of concepts relevant to the anchor query. We propose conceptual consistency to measure a LLM's understanding of relevant concepts. This novel metric measures how well a model can be characterized by finding out how consistent its responses to queries about conceptually relevant background knowledge are. To compute it we extract background knowledge by traversing paths between concepts in a knowledge base and then try to predict the model's response to the anchor query from the background knowledge. We investigate the performance of current LLMs in a commonsense reasoning setting using the CSQA dataset and the ConceptNet knowledge base. While conceptual consistency, like other metrics, does increase with the scale of the LLM used, we find that popular models do not necessarily have high conceptual consistency. Our analysis also shows significant variation in conceptual consistency across different kinds of relations, concepts, and prompts. This serves as a step toward building models that humans can apply a theory of mind to, and thus interact with intuitively.


title: Open-source tool for Airway Segmentation in Computed Tomography using 2.5D Modified EfficientDet: Contribution to the ATM22 Challenge

abstract: Airway segmentation in computed tomography images can be used to analyze pulmonary diseases, however, manual segmentation is labor intensive and relies on expert knowledge. This manuscript details our contribution to MICCAI's 2022 Airway Tree Modelling challenge, a competition of fully automated methods for airway segmentation. We employed a previously developed deep learning architecture based on a modified EfficientDet (MEDSeg), training from scratch for binary airway segmentation using the provided annotations. Our method achieved 90.72 Dice in internal validation, 95.52 Dice on external validation, and 93.49 Dice in the final test phase, while not being specifically designed or tuned for airway segmentation. Open source code and a pip package for predictions with our model and trained weights are in https://github.com/MICLab-Unicamp/medseg.


title: Integration factor combined with level set method for reaction-diffusion systems with free boundary in high spatial dimensions

abstract: For reaction-diffusion equations in irregular domain with moving boundaries, the numerical stability constraints from the reaction and diffusion terms often require very restricted time step size, while complex geometries may lead to difficulties in accuracy when discretizing the high-order derivatives on grid points near the boundary. It is very challenging to design numerical methods that can efficiently and accurately handle both difficulties. Applying an implicit scheme may be able to remove the stability constraints on the time step, however, it usually requires solving a large global system of nonlinear equations for each time step, and the computational cost could be significant. Integration factor (IF) or exponential differencing time (ETD) methods are one of the popular methods for temporal partial differential equations (PDEs) among many other methods. In our paper, we couple ETD methods with an embedded boundary method to solve a system of reaction-diffusion equations with complex geometries. In particular, we rewrite all ETD schemes into a linear combination of specific {\phi}-functions and apply one start-of-the-art algorithm to compute the matrix-vector multiplications, which offers significant computational advantages with adaptive Krylov subspaces. In addition, we extend this method by incorporating the level set method to solve the free boundary problem. The accuracy, stability, and efficiency of the developed method are demonstrated by numerical examples.


title: AICCA: AI-driven Cloud Classification Atlas

abstract: Clouds play an important role in the Earth's energy budget and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique by using a convolutional neural network. Our technique combines a rotation-invariant autoencoder with hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Thus, cloud classes are defined without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA's Aqua and Terra instruments - 800 TB of data or 198 million patches roughly 100 km x 100 km (128 x 128 pixels) - into 42 AI-generated cloud classes. We show that AICCA classes involve meaningful distinctions that employ spatial information and result in distinct geographic distributions, capturing, for example, stratocumulus decks along the West coasts of North and South America. AICCA delivers the information in multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.


title: Likelihood Adjusted Semidefinite Programs for Clustering Heterogeneous Data

abstract: Clustering is a widely deployed unsupervised learning tool. Model-based clustering is a flexible framework to tackle data heterogeneity when the clusters have different shapes. Likelihood-based inference for mixture distributions often involves non-convex and high-dimensional objective functions, imposing difficult computational and statistical challenges. The classic expectation-maximization (EM) algorithm is a computationally thrifty iterative method that maximizes a surrogate function minorizing the log-likelihood of observed data in each iteration, which however suffers from bad local maxima even in the special case of the standard Gaussian mixture model with common isotropic covariance matrices. On the other hand, recent studies reveal that the unique global solution of a semidefinite programming (SDP) relaxed $K$-means achieves the information-theoretically sharp threshold for perfectly recovering the cluster labels under the standard Gaussian mixture model. In this paper, we extend the SDP approach to a general setting by integrating cluster labels as model parameters and propose an iterative likelihood adjusted SDP (iLA-SDP) method that directly maximizes the exact observed likelihood in the presence of data heterogeneity. By lifting the cluster assignment to group-specific membership matrices, iLA-SDP avoids centroids estimation -- a key feature that allows exact recovery under well-separateness of centroids without being trapped by their adversarial configurations. Thus iLA-SDP is less sensitive than EM to initialization and more stable on high-dimensional data. Our numeric experiments demonstrate that iLA-SDP can achieve lower mis-clustering errors over several widely used clustering methods including $K$-means, SDP and EM algorithms.


title: Quark mass generation due to scalar fields with zero dimension

abstract: We propose a model of dynamical symmetry breaking, in which a new type of fundamental scalar fields of zero mass-dimension mediate the couplings of fermions to the gravitational field, represented here as a tetrad field in the same manner as Riemann-Cartan gravity. In our model, the tetrad couples to the standard model fermions non-minimally, and the very coupling coefficients are the fundamental scalar fields. There are exactly 36 scalar fields in the model, which are distinguishable by flavor indices on the fields. This is the precise number of zero dimension scalar fields that leads to a vanishing Weyl anomaly and a vanishing vacuum energy. Precisely the same number of these very same scalar fields is required for the coupling of all of the different standard model fermions to the vielbein field. At the same time their interaction with fermions gives rise to fermion mass terms, without the need to introduce a fundamental Higgs field. Within the proposed theory we construct a toy model that deals solely with the top and bottom quarks, and we demonstrate that their observable masses can appear in the action dynamically. Moreover, this mechanism allows for the top and bottom quarks to acquire distinctly different masses, as opposed to our previous, even simpler toy model that contained only the top quark.


title: MUG: Interactive Multimodal Grounding on User Interfaces

abstract: We present MUG, a novel interactive task for multimodal grounding where a user and an agent work collaboratively on an interface screen. Prior works modeled multimodal UI grounding in one round: the user gives a command and the agent responds to the command. Yet, in a realistic scenario, a user command can be ambiguous when the target action is inherently difficult to articulate in natural language. MUG allows multiple rounds of interactions such that upon seeing the agent responses, the user can give further commands for the agent to refine or even correct its actions. Such interaction is critical for improving grounding performances in real-world use cases. To investigate the problem, we create a new dataset that consists of 77,820 sequences of human user-agent interaction on mobile interfaces in which 20% involves multiple rounds of interactions. To establish our benchmark, we experiment with a range of modeling variants and evaluation strategies, including both offline and online evaluation-the online strategy consists of both human evaluation and automatic with simulators. Our experiments show that allowing iterative interaction significantly improves the absolute task completion by 18% over the entire test dataset and 31% over the challenging subset. Our results lay the foundation for further investigation of the problem.


title: Ethylenediamine Addition Improves Performance and Suppresses Phase Instabilities in Mixed-Halide Perovskites

abstract: We show that adding ethylenediamine (EDA) to perovskite precursor solution improves the photovoltaic device performance and material stability of high-bromide-content, methylammonium-free, formamidinium cesium lead halide perovskites FA1-xCsxPb(I1-yBry)3 which are currently of interest for perovskite-on-Si tandem solar cells. Using spectroscopy and hyperspectral microscopy, we show that the additive improves film homogeneity and suppresses the phase instability that is ubiquitous in high-Br perovskite formulations, producing films that remain stable for over 100 days in ambient conditions. With the addition of 1 mol% EDA we demonstrate 1.69 eV-gap perovskite single-junction p-i-n devices with a VOC of 1.22 V, and a champion maximum power point tracked power conversion efficiency of 18.8%, comparable to the best reported methylammonium-free perovskites. Using nuclear magnetic resonance (NMR) spectroscopy and X-ray diffraction techniques, we show that EDA reacts with FA+ in solution, rapidly and quantitatively forming imidazolinium cations. It is the presence of imidazolinium during crystallization which drives the improved perovskite thin-film properties.


title: Improving Molecular Pretraining with Complementary Featurizations

abstract: Molecular pretraining, which learns molecular representations over massive unlabeled data, has become a prominent paradigm to solve a variety of tasks in computational chemistry and drug discovery. Recently, prosperous progress has been made in molecular pretraining with different molecular featurizations, including 1D SMILES strings, 2D graphs, and 3D geometries. However, the role of molecular featurizations with their corresponding neural architectures in molecular pretraining remains largely unexamined. In this paper, through two case studies -- chirality classification and aromatic ring counting -- we first demonstrate that different featurization techniques convey chemical information differently. In light of this observation, we propose a simple and effective MOlecular pretraining framework with COmplementary featurizations (MOCO). MOCO comprehensively leverages multiple featurizations that complement each other and outperforms existing state-of-the-art models that solely relies on one or two featurizations on a wide range of molecular property prediction tasks.


title: Thurston's Theorem: Entropy in Dimension One

abstract: In his paper, Thurston shows that a positive real number $h$ is the topological entropy for an ergodic traintrack representative of an outer automorphism of a free group if and only if its expansion constant $\lambda = e^h$ is a weak Perron number. This is a powerful result, answering a question analogous to one regarding surfaces and stretch factors of pseudo-Anosov homeomorphisms. However, much of the machinery used to prove this seminal theorem on traintrack maps is contained in the part of Thurston's paper on the entropy of postcritically finite interval maps and the proof difficult to parse. In this expository paper, we modernize Thurston's approach, fill in gaps in the original paper, and distill Thurston's methods to give a cohesive proof of the traintrack theorem. Of particular note is the addition of a proof of ergodicity of the traintrack representatives, which was missing in Thurston's paper.


title: Data Querying with Ciphertext Policy Attribute Based Encryption

abstract: Data encryption limits the power and efficiency of queries. Direct processing of encrypted data should ideally be possible to avoid the need for data decryption, processing, and re-encryption. It is vital to keep the data searchable and sortable. That is, some information is intentionally leaked. This intentional leakage technology is known as "querying over encrypted data schemes", which offer confidentiality as well as querying over encrypted data, but it is not meant to provide flexible access control. This paper suggests the use of Ciphertext Policy Attributes Based Encryption (CP-ABE) to address three security requirements, namely: confidentiality, queries over encrypted data, and flexible access control. By combining flexible access control and data confidentiality, CP-ABE can authenticate who can access data and possess the secret key. Thus, this paper identifies how much data leakage there is in order to figure out what kinds of operations are allowed when data is encrypted by CP-ABE.


title: OAK4XAI: Model towards Out-Of-Box eXplainable Artificial Intelligence for Digital Agriculture

abstract: Recent machine learning approaches have been effective in Artificial Intelligence (AI) applications. They produce robust results with a high level of accuracy. However, most of these techniques do not provide human-understandable explanations for supporting their results and decisions. They usually act as black boxes, and it is not easy to understand how decisions have been made. Explainable Artificial Intelligence (XAI), which has received much interest recently, tries to provide human-understandable explanations for decision-making and trained AI models. For instance, in digital agriculture, related domains often present peculiar or input features with no link to background knowledge. The application of the data mining process on agricultural data leads to results (knowledge), which are difficult to explain. In this paper, we propose a knowledge map model and an ontology design as an XAI framework (OAK4XAI) to deal with this issue. The framework does not only consider the data analysis part of the process, but it takes into account the semantics aspect of the domain knowledge via an ontology and a knowledge map model, provided as modules of the framework. Many ongoing XAI studies aim to provide accurate and verbalizable accounts for how given feature values contribute to model decisions. The proposed approach, however, focuses on providing consistent information and definitions of concepts, algorithms, and values involved in the data mining models. We built an Agriculture Computing Ontology (AgriComO) to explain the knowledge mined in agriculture. AgriComO has a well-designed structure and includes a wide range of concepts and transformations suitable for agriculture and computing domains.


title: (3-Aminopropyl)trimethoxysilane Surface Passivation Improves Perovskite Solar Cell Performance by Reducing Surface Recombination Velocity

abstract: We demonstrate reduced surface recombination velocity (SRV) and enhanced power-conversion efficiency (PCE) in mixed-cation mixed-halide perovskite solar cells by using (3-aminopropyl)trimethoxysilane (APTMS) as a surface passivator. We show the APTMS serves to passivate defects at the perovskite surface, while also decoupling the perovskite from detrimental interactions at the C60 interface. We measure a SRV of ~125 + 14 cm/s, and a concomitant increase of ~100 meV in quasi-Fermi level splitting in passivated devices compared to the controls. We use time-resolved photoluminescence and excitation-correlation photoluminescence spectroscopy to show that APTMS passivation effectively suppresses non-radiative recombination. We show that APTMS improves both the fill factor and open-circuit voltage (VOC), increasing VOC from 1.03 V for control devices to 1.09 V for APTMS-passivated devices, which leads to PCE increasing from 15.90% to 18.03%. We attribute enhanced performance to reduced defect density or suppressed nonradiative recombination and low SRV at the perovskite/transporting layers interface.


title: Restricted Strong Convexity of Deep Learning Models with Smooth Activations

abstract: We consider the problem of optimization of deep learning models with smooth activation functions. While there exist influential results on the problem from the ``near initialization'' perspective, we shed considerable new light on the problem. In particular, we make two key technical contributions for such models with $L$ layers, $m$ width, and $\sigma_0^2$ initialization variance. First, for suitable $\sigma_0^2$, we establish a $O(\frac{\text{poly}(L)}{\sqrt{m}})$ upper bound on the spectral norm of the Hessian of such models, considerably sharpening prior results. Second, we introduce a new analysis of optimization based on Restricted Strong Convexity (RSC) which holds as long as the squared norm of the average gradient of predictors is $\Omega(\frac{\text{poly}(L)}{\sqrt{m}})$ for the square loss. We also present results for more general losses. The RSC based analysis does not need the ``near initialization" perspective and guarantees geometric convergence for gradient descent (GD). To the best of our knowledge, ours is the first result on establishing geometric convergence of GD based on RSC for deep learning models, thus becoming an alternative sufficient condition for convergence that does not depend on the widely-used Neural Tangent Kernel (NTK). We share preliminary experimental results supporting our theoretical advances.


title: Hidden in Plain Sight: Exploring Encrypted Channels in Android apps

abstract: As privacy features in Android operating system improve, privacy-invasive apps may gradually shift their focus to non-standard and covert channels for leaking private user/device information. Such leaks also remain largely undetected by state-of-the-art privacy analysis tools, which are very effective in uncovering privacy exposures via regular HTTP and HTTPS channels. In this study, we design and implement, ThirdEye, to significantly extend the visibility of current privacy analysis tools, in terms of the exposures that happen across various non-standard and covert channels, i.e., via any protocol over TCP/UDP (beyond HTTP/S), and using multi-layer custom encryption over HTTP/S and non-HTTP protocols. Besides network exposures, we also consider covert channels via storage media that also leverage custom encryption layers. Using ThirdEye, we analyzed 12,598 top-apps in various categories from Androidrank, and found that 2887/12,598 (22.92%) apps used custom encryption/decryption for network transmission and storing content in shared device storage, and 2465/2887 (85.38%) of those apps sent device information (e.g., advertising ID, list of installed apps) over the network that can fingerprint users. Besides, 299 apps transmitted insecure encrypted content over HTTP/non-HTTP protocols; 22 apps that used authentication tokens over HTTPS, happen to expose them over insecure (albeit custom encrypted) HTTP/non-HTTP channels. We found non-standard and covert channels with multiple levels of obfuscation (e.g., encrypted data over HTTPS, encryption at nested levels), and the use of vulnerable keys and cryptographic algorithms. Our findings can provide valuable insights into the evolving field of non-standard and covert channels, and help spur new countermeasures against such privacy leakage and security issues.


title: How to tackle an emerging topic? Combining strong and weak labels for Covid news NER

abstract: Being able to train Named Entity Recognition (NER) models for emerging topics is crucial for many real-world applications especially in the medical domain where new topics are continuously evolving out of the scope of existing models and datasets. For a realistic evaluation setup, we introduce a novel COVID-19 news NER dataset (COVIDNEWS-NER) and release 3000 entries of hand annotated strongly labelled sentences and 13000 auto-generated weakly labelled sentences. Besides the dataset, we propose CONTROSTER, a recipe to strategically combine weak and strong labels in improving NER in an emerging topic through transfer learning. We show the effectiveness of CONTROSTER on COVIDNEWS-NER while providing analysis on combining weak and strong labels for training. Our key findings are: (1) Using weak data to formulate an initial backbone before tuning on strong data outperforms methods trained on only strong or weak data. (2) A combination of out-of-domain and in-domain weak label training is crucial and can overcome saturation when being training on weak labels from a single source.


title: ConceptNet infused DialoGPT for Underlying Commonsense Understanding and Reasoning in Dialogue Response Generation

abstract: The pre-trained conversational models still fail to capture the implicit commonsense (CS) knowledge hidden in the dialogue interaction, even though they were pre-trained with an enormous dataset. In order to build a dialogue agent with CS capability, we firstly inject external knowledge into a pre-trained conversational model to establish basic commonsense through efficient Adapter tuning (Section 4). Secondly, we propose the ``two-way learning'' method to enable the bidirectional relationship between CS knowledge and sentence pairs so that the model can generate a sentence given the CS triplets, also generate the underlying CS knowledge given a sentence (Section 5). Finally, we leverage this integrated CS capability to improve open-domain dialogue response generation so that the dialogue agent is capable of understanding the CS knowledge hidden in dialogue history on top of inferring related other knowledge to further guide response generation (Section 6). The experiment results demonstrate that CS\_Adapter fusion helps DialoGPT to be able to generate series of CS knowledge. And the DialoGPT+CS\_Adapter response model adapted from CommonGen training can generate underlying CS triplets that fits better to dialogue context.


title: High Altitude characterization of the Hunga Pressure Wave with Cosmic Rays by the HAWC Observatory

abstract: High-energy cosmic rays that hit the Earth can be used to study large-scale atmospheric perturbations. After a first interaction in the upper parts of the atmosphere, cosmic rays produce a shower of particles that sample the atmosphere down to the detector level. The HAWC (High-Altitude Water Cherenkov) cosmic-ray observatory in Central Mexico at 4,100 m elevation detects air shower particles continuously with 300 water Cherenkov detectors with an active area of 12,500 m$^{2}$. On January 15th, 2022, HAWC detected the passage of the pressure wave created by the explosion of the Hunga volcano in the Tonga islands, 9,000 km away, as an anomaly in the measured rate of shower particles. The HAWC measurements are used to characterize the shape of four pressure wave passages, determine the propagation speed of each one, and correlate the variations of the shower particle rates with the barometric pressure changes, extracting a barometric parameter. The profile of the shower particle rate and atmospheric pressure variations for the first transit of the pressure wave at HAWC is compared to the pressure measurements at Tonga island, near the volcanic explosion. This work opens the possibility of using large particle cosmic-ray air shower detectors to trace large atmospheric transient waves.


title: Quantifying Harm

abstract: In a companion paper (Beckers et al. 2022), we defined a qualitative notion of harm: either harm is caused, or it is not. For practical applications, we often need to quantify harm; for example, we may want to choose the lest harmful of a set of possible interventions. We first present a quantitative definition of harm in a deterministic context involving a single individual, then we consider the issues involved in dealing with uncertainty regarding the context and going from a notion of harm for a single individual to a notion of "societal harm", which involves aggregating the harm to individuals. We show that the "obvious" way of doing this (just taking the expected harm for an individual and then summing the expected harm over all individuals can lead to counterintuitive or inappropriate answers, and discuss alternatives, drawing on work from the decision-theory literature.


title: Machine-learning classification of astronomical sources: estimating F1-score in the absence of ground truth

abstract: Machine-learning based classifiers have become indispensable in the field of astrophysics, allowing separation of astronomical sources into various classes, with computational efficiency suitable for application to the enormous data volumes that wide-area surveys now typically produce. In the standard supervised classification paradigm, a model is typically trained and validated using data from relatively small areas of sky, before being used to classify sources in other areas of the sky. However, population shifts between the training examples and the sources to be classified can lead to `silent' degradation in model performance, which can be challenging to identify when the ground-truth is not available. In this Letter, we present a novel methodology using the NannyML Confidence-Based Performance Estimation (CBPE) method to predict classifier F1-score in the presence of population shifts, but without ground-truth labels. We apply CBPE to the selection of quasars with decision-tree ensemble models, using broad-band photometry, and show that the F1-scores are predicted remarkably well (MAPE ~ 10%; R^2 = 0.74-0.92). We discuss potential use-cases in the domain of astronomy, including machine-learning model and/or hyperparameter selection, and evaluation of the suitability of training datasets for a particular classification problem.


title: Fast Radio Bursts as Probes of Magnetic Fields in Galaxies at z < 0.5

abstract: We present a sample of nine Fast Radio Bursts (FRBs) from which we derive magnetic field strengths of the host galaxies represented by normal, $z<0.5$ star-forming galaxies with stellar masses $M_* \approx 10^8 -10^{10.5} M_\odot$. We find no correlation between the FRB rotation measure(RM) and redshift which indicates that the RM values are due mostly to the FRB host contribution. This assertion is further supported by strong correlations (Spearman test probabilities $P_S \simeq 0.05$) found between RM and the estimated host dispersion measure ($DM_{Host}$) and host-normalized galacto-centric offset (Spearman $r_S$ values equal to 0.64 and -0.52). For these nine galaxies, we estimate their magnetic field strengths projected along the sightline $B$ finding a low median value of $0.5 \mu G$. This implies the magnetic fields of our sample of hosts are weaker than those characteristic of the Solar neighborhood ($\approx 6 \mu G$), but relatively consistent with a lower limit on observed range of $2-10 \mu G$ for star-forming, disk galaxies, especially as we consider reversals in the B-field, and that we are only probing $B_{\parallel}$. We compare to RMs from simulated galaxies of the Auriga project -- magneto-hydrodynamic cosmological zoom simulations - and find that the simulations predict the observed values to within the $95\%$ CI. Upcoming FRB surveys will provide hundreds of new FRBs with high-precision localizations, rotation measures, and imaging follow-up to support further investigation on the magnetic fields of a diverse population of $z<1$ galaxies.


title: Equidistribution and partition polynomials

abstract: Using equidistribution criteria, we establish divisibility by cyclotomic polynomials of several partition polynomials of interest, including $spt$-crank, overpartition pairs, and $t$-core partitions. As corollaries, we obtain new proofs of various Ramanujan-type congruences for associated partition functions. Moreover, using results of Erd\"os and Tur\'an, we establish the equidistribution of roots of partition polynomials on the unit circle including those for the rank, crank, $spt$, and unimodal sequences. Our results complement earlier work on this topic by Stanley, Boyer-Goh, and others. We explain how our methods may be used to establish similar results for other partition polynomials of interest, and offer many related open questions and examples.


title: Wave Sequential Data Assimilation in Support of Wave Energy Converter Power Prediction

abstract: Integration of renewable power sources into grids remains an active research and development area, particularly for less developed renewable energy technologies such as wave energy converters (WECs). WECs are projected to have strong early market penetration for remote communities, which serve as natural microgrids. Hence, accurate wave predictions to manage the interactions of a WEC array with microgrids is especially important. Recently developed, low-cost wave measurement buoys allow for operational assimilation of wave data at remote, site specific locations where real-time data have previously been unavailable. We present the development and assessment of a wave modeling framework with real-time data assimilation capabilities for WEC power prediction. The availability of real-time wave spectra from low-cost wave measurement buoys allows for operational data assimilation with the ensemble Kalman filter technique within a hybrid modeling procedure whereby physics-based numerical wave models are combined with data-driven error models that aim to capture the discrepancy in prescribed boundary conditions. With that aim, measured wave spectra are assimilated for combined state and parameter estimation while taking into account model and observational errors. The analysis allows for more accurate and precise wave characteristic predictions at the locations of interest. Initial deployment data obtained offshore Yakutat, Alaska, indicated that measured wave data from one buoy that were assimilated into the wave modeling framework resulted in improved forecast skill in comparison to traditional numerical forecasts.


title: Tropical adic spaces I: The continuous spectrum of a topological semiring

abstract: Towards building tropical analogues of adic spaces, we study certain spaces of prime congruences as a topological semiring replacement for the space of continuous valuations on a topological ring. This requires building the theory of topological idempotent semirings, and we consider semirings of convergent power series as a primary example. We consider the semiring of convergent power series as a topological space by defining a metric on it. We check that, in tropical toric cases, the proposed objects carry meaningful geometric information. In particular, we show that the dimension behaves as expected. We give an explicit characterization of the points in terms of classical polyhedral geometry in a follow up paper.


title: Structured Optimal Variational Inference for Dynamic Latent Space Models

abstract: We consider a latent space model for dynamic networks, where our objective is to estimate the pairwise inner products of the latent positions. To balance posterior inference and computational scalability, we present a structured mean-field variational inference framework, where the time-dependent properties of the dynamic networks are exploited to facilitate computation and inference. Additionally, an easy-to-implement block coordinate ascent algorithm is developed with message-passing type updates in each block, whereas the complexity per iteration is linear with the number of nodes and time points. To facilitate learning of the pairwise latent distances, we adopt a Gamma prior for the transition variance different from the literature. To certify the optimality, we demonstrate that the variational risk of the proposed variational inference approach attains the minimax optimal rate under certain conditions. En route, we derive the minimax lower bound, which might be of independent interest. To best of our knowledge, this is the first such exercise for dynamic latent space models. Simulations and real data analysis demonstrate the efficacy of our methodology and the efficiency of our algorithm. Finally, our proposed methodology can be readily extended to the case where the scales of the latent nodes are learned in a nodewise manner.


title: Linear Time-Varying Dynamic-Algebraic Equations of Index One on Time Scales

abstract: In this paper, we introduce a class of linear time-varying dynamic-algebraic equations(LTVDAE) of tractability index one on arbitrary time scales. We propose a procedure for the decoupling of the considered class LTVDAE. A projector approach is used to prove the main statement of the paper.


title: Blackbody temperature of 200+ stellar flares observed with the CoRoT satellite

abstract: We estimated blackbody temperature for 209 flares observed at 69 F-K stars, significantly increasing the number of flare temperature determinations. We used the Blue and Red channels obtained by the 27 cm telescope of the CoRoT satellite at high cadence and long duration. The wavelength limits of the channels were estimated using spectra from the Pickles library for the spectral type and luminosity class of each star, provided by the Exodat Database. The temperatures were obtained from the flare energy Blue-to-Red ratio, using the flare equivalent duration and stellar flux in both channels. The expected value of the analyzed flares is equal to 6,400 K with a standard deviation of 2,800 K, where the mean stellar spectral type, weighted by the number of flares in each spectral subclass, is equal to G6. Contrary to our results, a stellar white-light flare is often assumed to emit as a blackbody with a temperature of 9,000 K or 10,000 K. Our estimates agree, however, with values obtained for solar flares. The GAIA G-band transmissivity is comparable to that of the CoRoT White channel, which allows us to calibrate the flares to the Gaia photometric system. The energy in the G band of the analyzed flares varies between $10^{32}$ and $10^{37}$ erg and the flare area ranges from 30$\mu$sh to 3 sh (solar hemisphere). The energy release per area in a flare is proportional to $T_{\rm flare}^{2.6}$, at least up to 10,000 K.


title: An effective bound on Generalized Diophantine m-tuples

abstract: For non-zero integers $n$ and $k\geq2$, a generalized Diophantine $m$-tuple with property $D_k(n)$ is a set of $m$ positive integers $S = \{a_1,a_2,\ldots, a_m\}$ such that $a_ia_j + n$ is a $k$-th power for $1\leq i< j\leq m$. Define $M_k(n):= \sup\{|S| : S$ has property $D_k(n)\}$. In a recent work, the second author, S. Kim and M. R. Murty proved that $M_k(n)$ is $O(\log n)$, for a fixed $k$, as we vary $n$. In this paper, we obtain effective upper bounds on $M_k(n)$. In particular, we show that for $k\geq 2$, $M_k(n) \leq 3\,\phi(k)\, \log n$, if $n$ is sufficiently larger than $k$.


title: Heterogeneous reconstruction of deformable atomic models in Cryo-EM

abstract: Cryogenic electron microscopy (cryo-EM) provides a unique opportunity to study the structural heterogeneity of biomolecules. Being able to explain this heterogeneity with atomic models would help our understanding of their functional mechanisms but the size and ruggedness of the structural space (the space of atomic 3D cartesian coordinates) presents an immense challenge. Here, we describe a heterogeneous reconstruction method based on an atomistic representation whose deformation is reduced to a handful of collective motions through normal mode analysis. Our implementation uses an autoencoder. The encoder jointly estimates the amplitude of motion along the normal modes and the 2D shift between the center of the image and the center of the molecule . The physics-based decoder aggregates a representation of the heterogeneity readily interpretable at the atomic level. We illustrate our method on 3 synthetic datasets corresponding to different distributions along a simulated trajectory of adenylate kinase transitioning from its open to its closed structures. We show for each distribution that our approach is able to recapitulate the intermediate atomic models with atomic-level accuracy.


title: Quantum Clock Synchronization for Future NASA Deep Space Quantum Links and Fundamental Science

abstract: The ability to measure, hold and distribute time with high precision and accuracy is a foundational capability for scientific exploration. Beyond fundamental science, time synchronization is an indispensable feature of public and private communication, navigation and ranging, and distributed sensing, amongst others technological applications. We propose the implementation of a quantum network of satellite- and ground-based clocks with the ability to implement Quantum Clock Synchronization to picosecond accuracy. Implementation of the proposed QCS network offers a double advantage: (1) a more accurate, robust, and secure time synchronization network for classical applications than currently possible, and (2) a resource to fulfill the much more stringent synchronization requirements of future quantum communication networks.


title: Understanding Interventional TreeSHAP : How and Why it Works

abstract: Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the number of input features of an opaque model. Now, with efficient implementations such as Interventional TreeSHAP, this exponential burden is alleviated assuming one is explaining ensembles of decision trees. Although Interventional TreeSHAP has risen in popularity, it still lacks a formal proof of how/why it works. We provide such proof with the aim of not only increasing the transparency of the algorithm but also to encourage further development of these ideas. Notably, our proof for Interventional TreeSHAP is easily adapted to Shapley-Taylor indices and one-hot-encoded features.


title: Rochberg's abstract coboundary theorem revisited

abstract: Rochberg's coboundary theorem provides conditions under which the equation $(I-T)y = x$ is solvable in $y$. Here $T$ is a unilateral shift on Hilbert space, $I$ is the identity operator and $x$ is a given vector. The conditions are expressed in terms of Wold-type decomposition determined by $T$ and growth of iterates of $T$ at $x$. We revisit Rochberg's theorem and prove the following result. Let $T$ be an isometry acting on a Hilbert space $\mathcal{H}$ and let $x \in \mathcal{H}$. Suppose that $\sum_{k=0}^\infty k \| T^{*k} x \| < \infty$. Then $x$ is in the range of $(I-T)$ if (and only if) $\|\sum_{k= 0}^n T^k x \| = o(\sqrt{n}).$ When $T$ is merely a contraction, $x$ is a coboundary under an additional assumption. Some applications to $L^2$-solutions of the functional equation $f(x)-f(2x) = F(x)$, considered by Fortet and Kac, are given.


title: Geopolitical Implications of a Successful SETI Program

abstract: We discuss the recent "realpolitik" analysis of Wisian & Traphagan (2020, W&T) of the potential geopolitical fallout of the success of SETI. They conclude that "passive" SETI involves an underexplored yet significant risk that, in the event of a successful, passive detection of extraterrestrial technology, state-level actors could seek to gain an information monopoly on communications with an ETI. These attempts could lead to international conflict and potentially disastrous consequences. In response to this possibility, they argue that scientists and facilities engaged in SETI should preemptively engage in significant security protocols to forestall this risk. We find several flaws in their analysis. While we do not dispute that a realpolitik response is possible, we uncover concerns with W&T's presentation of the realpolitik paradigm, and we argue that sufficient reason is not given to justify treating this potential scenario as action-guiding over other candidate geopolitical responses. Furthermore, even if one assumes that a realpolitik response is the most relevant geopolitical response, we show that it is highly unlikely that a nation could successfully monopolize communication with ETI. Instead, the real threat that the authors identify is based on the perception by state actors that an information monopoly is likely. However, as we show, this perception is based on an overly narrow contact scenario. Overall, we critique W&T's argument and resulting recommendations on technical, political, and ethical grounds. Ultimately, we find that not only are W&T's recommendations unlikely to work, they may also precipitate the very ills that they foresee. As an alternative, we recommend transparency and data sharing (which are consistent with currently accepted best practices), further development of post-detection protocols, and better education of policymakers in this space.


title: Mapping of Elastic Properties of Twisting Metamaterials onto Micropolar Continuum using Static Calculations

abstract: Recent developments in the engineering of metamaterials have brought forth a myriad of mesmerizing mechanical properties that do not exist in ordinary solids. Among these, twisting metamaterials, acoustical chirality, or Willis coupling are sample-size dependent. The purpose of this work is, first, to examine the mechanical performance of a new twisting cubic metamaterial. Then, we perform a comparative investigation of its twisting behavior using the finite element method on microstructure elements computation, an analytical model, and we compare them to Eringen micropolar continuum. Notably, the results of the three models are in good qualitative and quantitative agreements. Finally, a systematic comparison of dispersion relations was made for the continuum and for the microstructures with different sizes in unit cells as final proof of perfect mapping.


title: Absorption lines from magnetically driven winds in X-ray binaries II: high resolution observational signatures expected from future X-ray observatories

abstract: In our self-similar, analytical, magneto-hydrodynamic (MHD) accretion-ejection solution, the density at the base of the outflow is explicitly dependent on the disk accretion rate - a unique property of this class of solutions. We had earlier found that the ejection index $p >\sim 0.1 (\dot{M}_{acc} \propto r^p ) $ is a key MHD parameter that decides if the flow can cause absorption lines in the high resolution X-ray spectra of black hole binaries. Here we choose 3 dense warm solutions with $p = 0.1, 0.3, 0.45$ and carefully develop a methodology to generate spectra which are convolved with the Athena and XRISM response functions to predict what they will observe seeing through such MHD outflows. In this paper two other external parameters were varied - extent of the disk, $\rm{r_o|_{max}} = 10^5, \, 10^6 \,\, \rm{r_G}$, and the angle of the line of sight, $i \sim 10 - 25^{\circ}$. Resultant absorption lines (H and He-like Fe, Ca, Ar) change in strength and their profiles manifest varying degrees of asymmetry. We checked if a) the lines and ii) the line asymmetries are detected, in our suit of synthetic Athena and XRISM spectra. Our analysis shows that Athena should detect the lines and their asymmetries for a standard 100 ksec observation of a 100 mCrab source - lines with equivalent width as low as a few eV should be detected if the 6-8 keV counts are larger than $10^4 - 10^5$ even for the least favourable simulated cases.


title: The modular isomorphism problem and abelian direct factors

abstract: Let $p$ be a prime and let $G$ be a finite $p$-group. We show that the isomorphism type of the maximal abelian direct factor of $G$, as well as the isomorphism type of the group algebra over $\mathbb F_p$ of the non-abelian remaining direct factor, are determined by $\mathbb F_p G$, generalizing the main result in arXiv:2110.10025 over the prime field. In order to do this, we address the problem of finding characteristic subgroups of $G$ such that their relative augmentation ideals depend only on the $k$-algebra structure of $kG$, where $k$ is any field of characteristic $p$, and relate it to the modular isomorphism problem, reproving and extending some known results.


title: Boundary control of time-harmonic eddy current equations

abstract: Motivated by various applications, this article develops the notion of boundary control for Maxwell's equations in the frequency domain. Surface curl is shown to be the appropriate regularization in order for the optimal control problem to be well-posed. Since, all underlying variables are assumed to be complex valued, the standard results on differentiability do not directly apply. Instead, we extend the notion of Wirtinger derivatives to complexified Hilbert spaces. Optimality conditions are rigorously derived and higher order boundary regularity of the adjoint variable is established. The state and adjoint variables are discretized using higher order N\'ed\'elec finite elements. The finite element space for controls is identified, as a space, which preserves the structure of the control regularization. Convergence of the fully discrete scheme is established. The theory is validated by numerical experiments, in some cases, motivated by realistic applications.


title: Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspective

abstract: We study a general matrix optimization problem with a fixed-rank positive semidefinite (PSD) constraint. We perform the Burer-Monteiro factorization and consider a particular Riemannian quotient geometry in a search space that has a total space equipped with the Euclidean metric. When the original objective f satisfies standard restricted strong convexity and smoothness properties, we characterize the global landscape of the factorized objective under the Riemannian quotient geometry. We show the entire search space can be divided into three regions: (R1) the region near the target parameter of interest, where the factorized objective is geodesically strongly convex and smooth; (R2) the region containing neighborhoods of all strict saddle points; (R3) the remaining regions, where the factorized objective has a large gradient. To our best knowledge, this is the first global landscape analysis of the Burer-Monteiro factorized objective under the Riemannian quotient geometry. Our results provide a fully geometric explanation for the superior performance of vanilla gradient descent under the Burer-Monteiro factorization. When f satisfies a weaker restricted strict convexity property, we show there exists a neighborhood near local minimizers such that the factorized objective is geodesically convex. To prove our results we provide a comprehensive landscape analysis of a matrix factorization problem with a least squares objective, which serves as a critical bridge. Our conclusions are also based on a result of independent interest stating that the geodesic ball centered at Y with a radius 1/3 of the least singular value of Y is a geodesically convex set under the Riemannian quotient geometry, which as a corollary, also implies a quantitative bound of the convexity radius in the Bures-Wasserstein space. The convexity radius obtained is sharp up to constants.

categories: math.OC cs.IT cs.LG cs.NA eess.SP math.IT math.NA


title: A Model for Dark Energy Based on Baryonic Charges with General Yang-Mills Symmetry

abstract: General Yang-Mills symmetry and Yang-Mills gravity in inertial frames presents a possible avenue for understanding dark energy phenomenon in terms of the extremely small baryon charges of protons and neutrons. General gauge transformations involve vector gauge functions and Hamilton's characteristic phase functions rather than scalar gauge functions and usual phase functions. One has fourth-order gauge field equations, which lead to a static linear potential between two point baryonic charges. Together with gravitational force, the model predicts that in the early universe, when the gravitational force was dominant, not only was the expansion occurring at a decreasing rate, the rate of change of the deceleration was decreasing due to a $1/r^2$ dependence. In the present universe, when the baryonic force is dominant, the cosmic acceleration should be approximately constant and has a maximum value $a_{max}\approx 10^{-13} m/s^2$, as measured in an inertial frame. We hope that these properties of the late-time cosmic acceleration can be tested in the future.


title: Dynamic Inference on Graphs using Structured Transition Models

abstract: Enabling robots to perform complex dynamic tasks such as picking up an object in one sweeping motion or pushing off a wall to quickly turn a corner is a challenging problem. The dynamic interactions implicit in these tasks are critical towards the successful execution of such tasks. Graph neural networks (GNNs) provide a principled way of learning the dynamics of interactive systems but can suffer from scaling issues as the number of interactions increases. Furthermore, the problem of using learned GNN-based models for optimal control is insufficiently explored. In this work, we present a method for efficiently learning the dynamics of interacting systems by simultaneously learning a dynamic graph structure and a stable and locally linear forward model of the system. The dynamic graph structure encodes evolving contact modes along a trajectory by making probabilistic predictions over the edges of the graph. Additionally, we introduce a temporal dependence in the learned graph structure which allows us to incorporate contact measurement updates during execution thus enabling more accurate forward predictions. The learned stable and locally linear dynamics enable the use of optimal control algorithms such as iLQR for long-horizon planning and control for complex interactive tasks. Through experiments in simulation and in the real world, we evaluate the performance of our method by using the learned interaction dynamics for control and demonstrate generalization to more objects and interactions not seen during training. We introduce a control scheme that takes advantage of contact measurement updates and hence is robust to prediction inaccuracies during execution.


title: Modeling driver's evasive behavior during safety-critical lane changes:Two-dimensional time-to-collision and deep reinforcement learning

abstract: Lane changes are complex driving behaviors and frequently involve safety-critical situations. This study aims to develop a lane-change-related evasive behavior model, which can facilitate the development of safety-aware traffic simulations and predictive collision avoidance systems. Large-scale connected vehicle data from the Safety Pilot Model Deployment (SPMD) program were used for this study. A new surrogate safety measure, two-dimensional time-to-collision (2D-TTC), was proposed to identify the safety-critical situations during lane changes. The validity of 2D-TTC was confirmed by showing a high correlation between the detected conflict risks and the archived crashes. A deep deterministic policy gradient (DDPG) algorithm, which could learn the sequential decision-making process over continuous action spaces, was used to model the evasive behaviors in the identified safety-critical situations. The results showed the superiority of the proposed model in replicating both the longitudinal and lateral evasive behaviors.


title: Traveling wave solutions for non-Newtonian foam flow in porous media

abstract: The injection and in-situ generation of foam in porous media successfully control gas mobility and improve the fluids' sweep efficiency inside porous media. Mathematical models describing this problem use two phases, foamed gas and fluid, and usually have a term for foam generation and destruction. Moreover, the non-Newtonian foam behavior is frequently modeled using the Hirasaki and Lawson's formula for foamed gas viscosity. In this paper, we detail how the traveling wave analysis can be used to estimate the propagation profiles and velocity for a range of non-Newtonian foam models in porous media at constant total superficial flow velocity. We reformulate Hirasaki and Lawson's formula in an explicit form allowing us to find traveling wave solutions for the non-Newtonian Linear Kinetic model. Comparing the solution with the one for the Newtonian version, allows us to analyze qualitatively and quantitatively the rheology of the foam flow in porous media.


title: Learning an Efficient Terrain Representation for Haptic Localization of a Legged Robot

abstract: Although haptic sensing has recently been used for legged robot localization in extreme environments where a camera or LiDAR might fail, the problem of efficiently representing the haptic signatures in a learned prior map is still open. This paper introduces an approach to terrain representation for haptic localization inspired by recent trends in machine learning. It combines this approach with the proven Monte Carlo algorithm to obtain an accurate, computation-efficient, and practical method for localizing legged robots under adversarial environmental conditions. We apply the triplet loss concept to learn highly descriptive embeddings in a transformer-based neural network. As the training haptic data are not labeled, the positive and negative examples are discriminated by their geometric locations discovered while training. We demonstrate experimentally that the proposed approach outperforms by a large margin the previous solutions to haptic localization of legged robots concerning the accuracy, inference time, and the amount of data stored in the map. As far as we know, this is the first approach that completely removes the need to use a dense terrain map for accurate haptic localization, thus paving the way to practical applications.


title: Low-Dose CT Using Denoising Diffusion Probabilistic Model for 20$\times$ Speedup

abstract: Low-dose computed tomography (LDCT) is an important topic in the field of radiology over the past decades. LDCT reduces ionizing radiation-induced patient health risks but it also results in a low signal-to-noise ratio (SNR) and a potential compromise in the diagnostic performance. In this paper, to improve the LDCT denoising performance, we introduce the conditional denoising diffusion probabilistic model (DDPM) and show encouraging results with a high computational efficiency. Specifically, given the high sampling cost of the original DDPM model, we adapt the fast ordinary differential equation (ODE) solver for a much-improved sampling efficiency. The experiments show that the accelerated DDPM can achieve 20x speedup without compromising image quality.


title: Generalizable machine learning for stress monitoring from wearable devices: A systematic literature review

abstract: Introduction. The stress response has both subjective, psychological and objectively measurable, biological components. Both of them can be expressed differently from person to person, complicating the development of a generic stress measurement model. This is further compounded by the lack of large, labeled datasets that can be utilized to build machine learning models for accurately detecting periods and levels of stress. The aim of this review is to provide an overview of the current state of stress detection and monitoring using wearable devices, and where applicable, machine learning techniques utilized. Methods. This study reviewed published works contributing and/or using datasets designed for detecting stress and their associated machine learning methods, with a systematic review and meta-analysis of those that utilized wearable sensor data as stress biomarkers. The electronic databases of Google Scholar, Crossref, DOAJ and PubMed were searched for relevant articles and a total of 24 articles were identified and included in the final analysis. The reviewed works were synthesized into three categories of publicly available stress datasets, machine learning, and future research directions. Results. A wide variety of study-specific test and measurement protocols were noted in the literature. A number of public datasets were identified that are labeled for stress detection. In addition, we discuss that previous works show shortcomings in areas such as their labeling protocols, lack of statistical power, validity of stress biomarkers, and generalization ability. Conclusion. Generalization of existing machine learning models still require further study, and research in this area will continue to provide improvements as newer and more substantial datasets become available for study.


title: Flexibility-assisted heat removal in thin crystalline silicon solar cells

abstract: Thin crystalline silicon solar photovoltaics holds great potential for reducing the module price by material saving and increasing the efficiency by reduced bulk recombination loss. However, the module efficiency decreases rather sensitively as the module temperature rises under sunlight. Effective, inexpensive approach to cooling modules would accelerate large-scale market adoption of thin crystalline silicon photovoltaics. For effective cooling, we exploit high flexibility of single-crystalline thin silicon films to create wavy solar cells. These wavy cells possess larger surface area than conventional flat cells, while occupying the same projected area. We experimentally demonstrate that the temperature of thin wavy crystalline silicon solar cells under the sunlight can be significantly reduced by increased convective cooling due to their large surface area. The substantial efficiency gain, achieved by the effective heat removal, points to high-performance thin crystalline silicon photovoltaic systems that are radically different in configuration from conventional systems.


title: Augmentation Backdoors

abstract: Data augmentation is used extensively to improve model generalisation. However, reliance on external libraries to implement augmentation methods introduces a vulnerability into the machine learning pipeline. It is well known that backdoors can be inserted into machine learning models through serving a modified dataset to train on. Augmentation therefore presents a perfect opportunity to perform this modification without requiring an initially backdoored dataset. In this paper we present three backdoor attacks that can be covertly inserted into data augmentation. Our attacks each insert a backdoor using a different type of computer vision augmentation transform, covering simple image transforms, GAN-based augmentation, and composition-based augmentation. By inserting the backdoor using these augmentation transforms, we make our backdoors difficult to detect, while still supporting arbitrary backdoor functionality. We evaluate our attacks on a range of computer vision benchmarks and demonstrate that an attacker is able to introduce backdoors through just a malicious augmentation routine.


title: Fully Proprioceptive Slip-Velocity-Aware State Estimation for Mobile Robots via Invariant Kalman Filtering and Disturbance Observer

abstract: This paper develops a novel slip estimator using the invariant observer design theory and Disturbance Observer (DOB). The proposed state estimator for mobile robots is fully proprioceptive and combines data from an inertial measurement unit and body velocity within a Right Invariant Extended Kalman Filter (RI-EKF). By embedding the slip velocity into $\mathrm{SE}_3(3)$ matrix Lie group, the developed DOB-based RI-EKF provides real-time velocity and slip velocity estimates on different terrains. Experimental results using a Husky wheeled robot confirm the mathematical derivations and effectiveness of the proposed method in estimating the observable state variables. Open-source software is available for download and reproducing the presented results.


title: On Convergence of Average-Reward Off-Policy Control Algorithms in Weakly Communicating MDPs

abstract: We show two average-reward off-policy control algorithms, Differential Q-learning (Wan, Naik, & Sutton 2021a) and RVI Q-learning (Abounadi Bertsekas & Borkar 2001), converge in weakly communicating MDPs. Weakly communicating MDPs are the most general MDPs that can be solved by a learning algorithm with a single stream of experience. The original convergence proofs of the two algorithms require that the solution set of the average-reward optimality equation only has one degree of freedom, which is not necessarily true for weakly communicating MDPs. To the best of our knowledge, our results are the first showing average-reward off-policy control algorithms converge in weakly communicating MDPs. As a direct extension, we show that average-reward options algorithms for temporal abstraction introduced by Wan, Naik, & Sutton (2021b) converge if the Semi-MDP induced by options is weakly communicating.


title: Maximal chain descent orders

abstract: This paper introduces a partial order on the maximal chains of any finite bounded poset $P$ which has a CL-labeling $\lambda$. We call this the maximal chain descent order induced by $\lambda$, denoted $P_{\lambda}(2)$. As a first example, letting $P$ be the Boolean lattice and $\lambda$ its standard EL-labeling gives $P_{\lambda}(2)$ isomorphic to the weak order of type A. We discuss in depth other seemingly well-structured examples: the max-min EL-labeling of the partition lattice gives maximal chain descent order isomorphic to a partial order on certain labeled trees, and particular cases of the linear extension EL-labelings of finite distributive lattices produce maximal chain descent orders isomorphic to partial orders on standard Young tableaux. We observe that the order relations which one might expect to be the cover relations, those given by the "polygon moves" whose transitive closure defines the maximal chain descent order, are not always cover relations. Several examples illustrate this fact. Nonetheless, we characterize the EL-labelings for which every polygon move gives a cover relation, and we prove many well known EL-labelings do have the expected cover relations. One motivation for $P_{\lambda}(2)$ is that its linear extensions give all of the shellings of the order complex of $P$ whose restriction maps are defined by the descents with respect to $\lambda$. This yields strictly more shellings of $P$ than the lexicographic ones induced by $\lambda$. Thus, the maximal chain descent order $P_{\lambda}(2)$ might be thought of as encoding the structure of the set of shellings induced by $\lambda$.


abstract: Recent years have witnessed a growing academic interest in multi-view subspace clustering. In this paper, we propose a novel Double Graphs Regularized Multi-view Subspace Clustering (DGRMSC) method, which aims to harness both global and local structural information of multi-view data in a unified framework. Specifically, DGRMSC firstly learns a latent representation to exploit the global complementary information of multiple views. Based on the learned latent representation, we learn a self-representation to explore its global cluster structure. Further, Double Graphs Regularization (DGR) is performed on both latent representation and self-representation to take advantage of their local manifold structures simultaneously. Then, we design an iterative algorithm to solve the optimization problem effectively. Extensive experimental results on real-world datasets demonstrate the effectiveness of the proposed method.


title: Optimizing the Placement of Numerical Relativity Simulations using a Mismatch Predicting Neural Network

abstract: Gravitational wave observations from merging compact objects are becoming commonplace, and as detectors improve and gravitational wave sources become more varied, it is increasingly important to have dense and expansive template banks of predicted gravitational waveforms. Since numerical relativity is the only way to fully solve the non-linear merger regime of general relativity for comparably massed systems, numerical relativity simulations are critical for gravitational wave detection and analysis. These simulations are computationally expensive, with each simulation placing one point within the high dimensional parameter space of binary black hole coalescences. This makes it important to have a method of placing new simulations in ways that use our computational resources optimally while ensuring sufficient coverage of the parameter space. Accomplishing this requires predicting the impact of a new set of parameters before performing the simulation. To this effect, this paper introduces a neural network to predict the mismatch between the gravitational waves of two binary systems. Using this network, we then show how we can propose new numerical relativity simulations that will provide the most benefit. We also use the network to identify gaps in existing public catalogs and identify degeneracies in the binary black hole parameter space.


title: Batch Multivalid Conformal Prediction

abstract: We develop fast distribution-free conformal prediction algorithms for obtaining multivalid coverage on exchangeable data in the batch setting. Multivalid coverage guarantees are stronger than marginal coverage guarantees in two ways: (1) They hold even conditional on group membership -- that is, the target coverage level $1-\alpha$ holds conditionally on membership in each of an arbitrary (potentially intersecting) group in a finite collection $\mathcal{G}$ of regions in the feature space. (2) They hold even conditional on the value of the threshold used to produce the prediction set on a given example. In fact multivalid coverage guarantees hold even when conditioning on group membership and threshold value simultaneously. We give two algorithms: both take as input an arbitrary non-conformity score and an arbitrary collection of possibly intersecting groups $\mathcal{G}$, and then can equip arbitrary black-box predictors with prediction sets. Our first algorithm (BatchGCP) is a direct extension of quantile regression, needs to solve only a single convex minimization problem, and produces an estimator which has group-conditional guarantees for each group in $\mathcal{G}$. Our second algorithm (BatchMVP) is iterative, and gives the full guarantees of multivalid conformal prediction: prediction sets that are valid conditionally both on group membership and non-conformity threshold. We evaluate the performance of both of our algorithms in an extensive set of experiments. Code to replicate all of our experiments can be found at https://github.com/ProgBelarus/BatchMultivalidConformal


title: Ensemble Machine Learning Model Trained on a New Synthesized Dataset Generalizes Well for Stress Prediction Using Wearable Devices

abstract: Introduction. We investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single, large dataset. Finally, we propose and evaluate the use of ensemble techniques by combining gradient boosting with an artificial neural network to measure predictive power on new, unseen data. Methods. Sensor biomarker data from six public datasets were utilized in this study. To test model generalization, we developed a gradient boosting model trained on one dataset (SWELL), and tested its predictive power on two datasets previously used in other studies (WESAD, NEURO). Next, we merged four small datasets, i.e. (SWELL, NEURO, WESAD, UBFC-Phys), to provide a combined total of 99 subjects,. In addition, we utilized random sampling combined with another dataset (EXAM) to build a larger training dataset consisting of 200 synthesized subjects,. Finally, we developed an ensemble model that combines our gradient boosting model with an artificial neural network, and tested it on two additional, unseen publicly available stress datasets (WESAD and Toadstool). Results. Our method delivers a robust stress measurement system capable of achieving 85% predictive accuracy on new, unseen validation data, achieving a 25% performance improvement over single models trained on small datasets. Conclusion. Models trained on small, single study protocol datasets do not generalize well for use on new, unseen data and lack statistical power. Ma-chine learning models trained on a dataset containing a larger number of varied study subjects capture physiological variance better, resulting in more robust stress detection.


title: Optimizing towards the best insertion-based error-tolerating joints

abstract: We present an optimization-based design process that can generate the best insertion-based joints with respect to different errors, including manipulation error, manufacturing error, and sensing error. We separate the analysis into two stages, the insertion and the after-insertion stability. Each sub-process is discretized into different modes of contacts. The transitions among the contact modes form a directed graph and the connectivity of the graph is achieved and maintained through the manipulation of the socket edge-angle and peg contact-point locations. The analysis starts in 2D with the assumption of point-edge contacts. During the optimization, the edges of the socket are rotated and the points on the peg are moved along the edges to ensure the successful insertion and the stability after insertion. We show in simulation that our proposed method can generate insertion-based joints that are tolerant to the given errors. and we present a few simple 3D projections to show that the analysis is still effective beyond 2D cases.


title: Embedded System Performance Analysis for Implementing a Portable Drowsiness Detection System for Drivers

abstract: Drowsiness on the road is a widespread problem with fatal consequences; thus, a multitude of systems and techniques have been proposed. Among existing methods, Ghoddoosian et al. utilized temporal blinking patterns to detect early signs of drowsiness, but their algorithm was tested only on a powerful desktop computer, which is not practical to apply in a moving vehicle setting. In this paper, we propose an efficient platform to run Ghoddosian's algorithm, detail the performance tests we ran to determine this platform, and explain our threshold optimization logic. After considering the Jetson Nano and Beelink (Mini PC), we concluded that the Mini PC is the most efficient and practical to run our embedded system in a vehicle. To determine this, we ran communication speed tests and evaluated total processing times for inference operations. Based on our experiments, the average total processing time to run the drowsiness detection model was 94.27 ms for Jetson Nano and 22.73 ms for the Beelink (Mini PC). Considering the portability and power efficiency of each device, along with the processing time results, the Beelink (Mini PC) was determined to be most suitable. Also, we propose a threshold optimization algorithm, which determines whether the driver is drowsy or alert based on the trade-off between the sensitivity and specificity of the drowsiness detection model. Our study will serve as a crucial next step for drowsiness detection research and its application in vehicles. Through our experiment, we have determinend a favorable platform that can run drowsiness detection algorithms in real-time and can be used as a foundation to further advance drowsiness detection research. In doing so, we have bridged the gap between an existing embedded system and its actual implementation in vehicles to bring drowsiness technology a step closer to prevalent real-life implementation.


title: Pure-Circuit: Strong Inapproximability for PPAD

abstract: The current state-of-the-art methods for showing inapproximability in PPAD arise from the $\varepsilon$-Generalized-Circuit ($\varepsilon$-GCircuit) problem. Rubinstein (2018) showed that there exists a small unknown constant $\varepsilon$ for which $\varepsilon$-GCircuit is PPAD-hard, and subsequent work has shown hardness results for other problems in PPAD by using $\varepsilon$-GCircuit as an intermediate problem. We introduce Pure-Circuit, a new intermediate problem for PPAD, which can be thought of as $\varepsilon$-GCircuit pushed to the limit as $\varepsilon \rightarrow 1$, and we show that the problem is PPAD-complete. We then prove that $\varepsilon$-GCircuit is PPAD-hard for all $\varepsilon < 0.1$ by a reduction from Pure-Circuit, and thus strengthen all prior work that has used GCircuit as an intermediate problem from the existential-constant regime to the large-constant regime. We show that stronger inapproximability results can be derived by reducing directly from Pure-Circuit. In particular, we prove tight inapproximability results for computing $\varepsilon$-well-supported Nash equilibria in two-action polymatrix games, as well as for finding approximate equilibria in threshold games.


title: Spatio-temporal Motion Planning for Autonomous Vehicles with Trapezoidal Prism Corridors and B\'{e}zier Curves

abstract: Safety-guaranteed motion planning is critical for self-driving cars to generate collision-free trajectories. A layered motion planning approach with decoupled path and speed planning is widely used for this purpose. This approach is prone to be suboptimal in the presence of dynamic obstacles. Spatial-temporal approaches deal with path planning and speed planning simultaneously; however, the existing methods only support simple-shaped corridors like cuboids, which restrict the search space for optimization in complex scenarios. We propose to use trapezoidal prism-shaped corridors for optimization, which significantly enlarges the solution space compared to the existing cuboidal corridors-based method. Finally, a piecewise B\'{e}zier curve optimization is conducted in our proposed corridors. This formulation theoretically guarantees the safety of the continuous-time trajectory. We validate the efficiency and effectiveness of the proposed approach in numerical and CommonRoad simulations.


title: Tight Inapproximability for Graphical Games

abstract: We provide a complete characterization for the computational complexity of finding approximate equilibria in two-action graphical games. We consider the two most well-studied approximation notions: $\varepsilon$-Nash equilibria ($\varepsilon$-NE) and $\varepsilon$-well-supported Nash equilibria ($\varepsilon$-WSNE), where $\varepsilon \in [0,1]$. We prove that computing an $\varepsilon$-NE is PPAD-complete for any constant $\varepsilon < 1/2$, while a very simple algorithm (namely, letting all players mix uniformly between their two actions) yields a $1/2$-NE. On the other hand, we show that computing an $\varepsilon$-WSNE is PPAD-complete for any constant $\varepsilon < 1$, while a $1$-WSNE is trivial to achieve, because any strategy profile is a $1$-WSNE. All of our lower bounds immediately also apply to graphical games with more than two actions per player.


title: An exceptional set estimate for restricted projections to lines in $\mathbb{R}^3$

abstract: Let $\gamma:[0,1]\rightarrow \mathbb{S}^{2}$ be a non-degenerate curve in $\mathbb{R}^3$, that is to say, $\det\big(\gamma(\theta),\gamma'(\theta),\gamma''(\theta)\big)\neq 0$. For each $\theta\in[0,1]$, let $l_\theta=\{t\gamma(\theta):t\in\mathbb{R}\}$ and $\rho_\theta:\mathbb{R}^3\rightarrow l_\theta$ be the orthogonal projections. We prove an exceptional set estimate. For any Borel set $A\subset\mathbb{R}^3$ and $0\le s\le 1$, define $E_s(A):=\{\theta\in[0,1]: \text{dim}(\rho_\theta(A))<s\}$. We have $\text{dim}(E_s(A))\le 1+\frac{s-\text{dim}(A)}{2}$.


title: MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priors

abstract: High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have shown a promising ability for complete scene reconstruction, while their results are often over-smooth and lack enough geometric details. This paper introduces a novel neural implicit scene representation with volume rendering for high-fidelity online 3D scene reconstruction from monocular videos. For fine-grained reconstruction, our key insight is to incorporate geometric priors into both the neural implicit scene representation and neural volume rendering, thus leading to an effective geometry learning mechanism based on volume rendering optimization. Benefiting from this, we present MonoNeuralFusion to perform the online neural 3D reconstruction from monocular videos, by which the 3D scene geometry is efficiently generated and optimized during the on-the-fly 3D monocular scanning. The extensive comparisons with state-of-the-art approaches show that our MonoNeuralFusion consistently generates much better complete and fine-grained reconstruction results, both quantitatively and qualitatively.


title: Variable-Based Calibration for Machine Learning Classifiers

abstract: The deployment of machine learning classifiers in high-stakes domains requires well-calibrated confidence scores for model predictions. In this paper we introduce the notion of variable-based calibration to characterize calibration properties of a model with respect to a variable of interest, generalizing traditional score-based metrics such as expected calibration error (ECE). In particular, we find that models with near-perfect ECE can exhibit significant miscalibration as a function of features of the data. We demonstrate this phenomenon both theoretically and in practice on multiple well-known datasets, and show that it can persist after the application of existing calibration methods. To mitigate this issue, we propose strategies for detection, visualization, and quantification of variable-based calibration error. We then examine the limitations of current score-based calibration methods and explore potential modifications. Finally, we discuss the implications of these findings, emphasizing that an understanding of calibration beyond simple aggregate measures is crucial for endeavors such as fairness and model interpretability.


title: Negative refraction in hyperbolic hetero-bicrystals

abstract: We visualized negative refraction of phonon polaritons, which occurs at the interface between two natural crystals. The polaritons - hybrids of infrared photons and lattice vibrations - form collimated rays that display negative refraction when passing through a planar interface between the two hyperbolic van der Waals materials: molybdenum oxide ($MoO_3$) and isotopically pure hexagonal boron nitride ($h^{11}BN$). At a special frequency $\omega_0$, these rays can circulate along closed diamond-shaped trajectories. We have shown that polariton eigenmodes display regions of both positive and negative dispersion interrupted by multiple gaps that result from polaritonic level repulsion and strong coupling.


title: Cooperative Beamforming Design for Multiple RIS-Assisted Communication Systems

abstract: Reconfigurable intelligent surface (RIS) provides a promising way to build programmable wireless transmission environments. Owing to the massive number of controllable reflecting elements on the surface, RIS is capable of providing considerable passive beamforming gains. At present, most related works mainly consider the modeling, design, performance analysis and optimization of single-RIS-assisted systems. Although there are a few of works that investigate multiple RISs individually serving their associated users, the cooperation among multiple RISs is not well considered as yet. To fill the gap, this paper studies a cooperative beamforming design for multi-RIS-assisted communication systems, where multiple RISs are deployed to assist the downlink communications from a base station to its users. To do so, we first model the general channel from the base station to the users for arbitrary number of reflection links. Then, we formulate an optimization problem to maximize the sum rate of all users. Analysis shows that the formulated problem is difficult to solve due to its non-convexity and the interactions among the decision variables. To solve it effectively, we first decouple the problem into three disjoint subproblems. Then, by introducing appropriate auxiliary variables, we derive the closed-form expressions for the decision variables and propose a low-complexity cooperative beamforming algorithm. Simulation results have verified the effectiveness of the proposed algorithm through comparison with various baseline methods. Furthermore, these results also unveil that, for the sum rate maximization, distributing the reflecting elements among multiple RISs is superior to deploying them at one single RIS.


title: Rethinking and Recomputing the Value of ML Models

abstract: In this paper, we argue that the way we have been training and evaluating ML models has largely forgotten the fact that they are applied in an organization or societal context as they provide value to people. We show that with this perspective we fundamentally change how we evaluate, select and deploy ML models - and to some extent even what it means to learn. Specifically, we stress that the notion of value plays a central role in learning and evaluating, and different models may require different learning practices and provide different values based on the application context they are applied. We also show that this concretely impacts how we select and embed models into human workflows based on experimental datasets. Nothing of what is presented here is hard: to a large extent is a series of fairly trivial observations with massive practical implications.


title: Lithium and Beryllium in One Solar Mass Stars

abstract: The surface content of lithium (Li) and beryllium (Be) in stars can reveal important information about the temperature structure and physical processes in their interior regions. This study focuses on solar-type stars with a sample that is more precisely defined than done previously. Our selection of stars studied for Be is constrained by five parameters: mass, temperature, surface gravity, metallicity, and age to be similar to the Sun and is focussed on stars within +-0.02 of 1 M_sun. We have used the Keck I telescope with HIRES to obtain spectra of the Be II spectral region of 52 such stars at high spectral resolution ($\sim$45,000) and high signal-to-noise ratios. While the spread in Li in these stars is greater than a factor of 400, the spread in Be is only 2.7 times. Two stars were without any Be, perhaps due to a merger or a mass transfer with a companion. We find a steep trend of Li with temperature but little for Be. While there is a downward trend in Li with [Fe/H] from -0.4 to +0.4 due to stellar depletion, there is a small increase in Be with Fe from Galactic Be enrichment. While there is a broad decline in Li with age, there may be a small increase in Be with age, though age is less well-determined. In the subset of stars closest to the Sun in temperature and other parameters we find that the ratio of the abundances of Be to Li is much lower than predicted by models; there may be other mixing mechanisms causing additional Li depletion.


title: MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Features

abstract: MobileViT (MobileViTv1) combines convolutional neural networks (CNNs) and vision transformers (ViTs) to create light-weight models for mobile vision tasks. Though the main MobileViTv1-block helps to achieve competitive state-of-the-art results, the fusion block inside MobileViTv1-block, creates scaling challenges and has a complex learning task. We propose changes to the fusion block that are simple and effective to create MobileViTv3-block, which addresses the scaling and simplifies the learning task. Our proposed MobileViTv3-block used to create MobileViTv3-XXS, XS and S models outperform MobileViTv1 on ImageNet-1k, ADE20K, COCO and PascalVOC2012 datasets. On ImageNet-1K, MobileViTv3-XXS and MobileViTv3-XS surpasses MobileViTv1-XXS and MobileViTv1-XS by 2% and 1.9% respectively. Recently published MobileViTv2 architecture removes fusion block and uses linear complexity transformers to perform better than MobileViTv1. We add our proposed fusion block to MobileViTv2 to create MobileViTv3-0.5, 0.75 and 1.0 models. These new models give better accuracy numbers on ImageNet-1k, ADE20K, COCO and PascalVOC2012 datasets as compared to MobileViTv2. MobileViTv3-0.5 and MobileViTv3-0.75 outperforms MobileViTv2-0.5 and MobileViTv2-0.75 by 2.1% and 1.0% respectively on ImageNet-1K dataset. For segmentation task, MobileViTv3-1.0 achieves 2.07% and 1.1% better mIOU compared to MobileViTv2-1.0 on ADE20K dataset and PascalVOC2012 dataset respectively. Our code and the trained models are available at: https://github.com/micronDLA/MobileViTv3


title: A gerby deformation of complex tori and the homological mirror symmetry

abstract: Let $(X,\check{X})$ be a mirror pair of a complex torus $X$ and its mirror partner $\check{X}$. This mirror pair is described as the trivial special Lagrangian torus fibrations $X\rightarrow B$ and $\check{X}\rightarrow B$ on the same base space $B$ by SYZ construction. Then, we can associate a holomorphic line bundle $E(s,\mathcal{L})\rightarrow X$ to a pair $(s,\mathcal{L})$ of a Lagrangian section $s$ of $\check{X}\rightarrow B$ and a unitary local system $\mathcal{L}$ along it. In this paper, we first construct the deformation $X_{\mathcal{G}}$ of $X$ by a certain flat gerbe $\mathcal{G}$ and its mirror partner $\check{X}_{\mathcal{G}}$ from the mirror pair $(X,\check{X})$, and discuss deformations of objects $E(s,\mathcal{L})$ and $(s,\mathcal{L})$ over the deformed mirror pair $(X_{\mathcal{G}},\check{X}_{\mathcal{G}})$.


title: Geography-aware Optimal UAV 3D Placement for LOS Relaying: A Geometry Approach

abstract: Many emerging technologies for the next generation wireless network prefer line-of-sight (LOS) propagation conditions to fully release their performance advantages. This paper studies 3D unmanned aerial vehicle (UAV) placement to establish LOS links for two ground terminals in deep shadow in a dense urban environment. The challenge is that the LOS region for the feasible UAV positions can be arbitrary due to the complicated structure of the environment. While most existing works rely on simplified stochastic LOS models and problem relaxations, this paper focuses on establishing theoretical guarantees for the optimal UAV placement to ensure LOS conditions for two ground users in an actual propagation environment. It is found that it suffices to search a bounded 2D area for the globally optimal 3D UAV position. Thus, this paper develops an exploration-exploitation algorithm with a linear trajectory length and achieves above 99% global optimality over several real city environments being tested in our experiments. To further enhance the search capability in an ultra-dense environment, a dynamic multi-stage algorithm is developed and theoretically shown to find an $\epsilon$-optimal UAV position with a search length $O(1/\epsilon)$. Significant performance advantages are demonstrated in several numerical experiments for wireless communication relaying and wireless power transfer.


title: Linearly Mapping from Image to Text Space

abstract: The extent to which text-only language models (LMs) learn to represent features of the non-linguistic world is an open question. Prior work has shown that pretrained LMs can be taught to caption images when a vision model's parameters are optimized to encode images in the language space. We test a stronger hypothesis: that the conceptual representations learned by frozen text-only models and vision-only models are similar enough that this can be achieved with a linear map. We show that the image representations from vision models can be transferred as continuous prompts to frozen LMs by training only a single linear projection. Using these to prompt the LM achieves competitive performance on captioning and visual question answering tasks compared to models that tune both the image encoder and text decoder (such as the MAGMA model). We compare three image encoders with increasing amounts of linguistic supervision seen during pretraining: BEIT (no linguistic information), NF-ResNET (lexical category information), and CLIP (full natural language descriptions). We find that all three encoders perform equally well at transferring visual property information to the language model (e.g., whether an animal is large or small), but that image encoders pretrained with linguistic supervision more saliently encode category information (e.g., distinguishing hippo vs. elephant) and thus perform significantly better on benchmark language-and-vision tasks. Our results indicate that LMs encode conceptual information structurally similarly to vision-based models, even those that are solely trained on images. Code is available here: https://github.com/jmerullo/limber


title: An analogue of ladder representations for classical groups

abstract: In this paper, we introduce a notion of ladder representations for split odd special orthogonal groups and symplectic groups over a non-archimedean local field of characteristic zero. This is a natural class in the admissible dual which contains both strongly positive discrete series representations and irreducible representations with irreducible A-parameters. We compute Jacquet modules and the Aubert duals of ladder representations, and we establish a formula to describing ladder representations in terms of linear combinations of standard modules.


title: Blur the Linguistic Boundary: Interpreting Chinese Buddhist Sutra in English via Neural Machine Translation

abstract: Buddhism is an influential religion with a long-standing history and profound philosophy. Nowadays, more and more people worldwide aspire to learn the essence of Buddhism, attaching importance to Buddhism dissemination. However, Buddhist scriptures written in classical Chinese are obscure to most people and machine translation applications. For instance, general Chinese-English neural machine translation (NMT) fails in this domain. In this paper, we proposed a novel approach to building a practical NMT model for Buddhist scriptures. The performance of our translation pipeline acquired highly promising results in ablation experiments under three criteria.


title: Distilling Style from Image Pairs for Global Forward and Inverse Tone Mapping

abstract: Many image enhancement or editing operations, such as forward and inverse tone mapping or color grading, do not have a unique solution, but instead a range of solutions, each representing a different style. Despite this, existing learning-based methods attempt to learn a unique mapping, disregarding this style. In this work, we show that information about the style can be distilled from collections of image pairs and encoded into a 2- or 3-dimensional vector. This gives us not only an efficient representation but also an interpretable latent space for editing the image style. We represent the global color mapping between a pair of images as a custom normalizing flow, conditioned on a polynomial basis of the pixel color. We show that such a network is more effective than PCA or VAE at encoding image style in low-dimensional space and lets us obtain an accuracy close to 40 dB, which is about 7-10 dB improvement over the state-of-the-art methods.


title: Reward Shaping for User Satisfaction in a REINFORCE Recommender

abstract: How might we design Reinforcement Learning (RL)-based recommenders that encourage aligning user trajectories with the underlying user satisfaction? Three research questions are key: (1) measuring user satisfaction, (2) combatting sparsity of satisfaction signals, and (3) adapting the training of the recommender agent to maximize satisfaction. For measurement, it has been found that surveys explicitly asking users to rate their experience with consumed items can provide valuable orthogonal information to the engagement/interaction data, acting as a proxy to the underlying user satisfaction. For sparsity, i.e, only being able to observe how satisfied users are with a tiny fraction of user-item interactions, imputation models can be useful in predicting satisfaction level for all items users have consumed. For learning satisfying recommender policies, we postulate that reward shaping in RL recommender agents is powerful for driving satisfying user experiences. Putting everything together, we propose to jointly learn a policy network and a satisfaction imputation network: The role of the imputation network is to learn which actions are satisfying to the user; while the policy network, built on top of REINFORCE, decides which items to recommend, with the reward utilizing the imputed satisfaction. We use both offline analysis and live experiments in an industrial large-scale recommendation platform to demonstrate the promise of our approach for satisfying user experiences.


title: An empirical study of weakly supervised audio tagging embeddings for general audio representations

abstract: We study the usability of pre-trained weakly supervised audio tagging (AT) models as feature extractors for general audio representations. We mainly analyze the feasibility of transferring those embeddings to other tasks within the speech and sound domains. Specifically, we benchmark weakly supervised pre-trained models (MobileNetV2 and EfficientNet-B0) against modern self-supervised learning methods (BYOL-A) as feature extractors. Fourteen downstream tasks are used for evaluation ranging from music instrument classification to language classification. Our results indicate that AT pre-trained models are an excellent transfer learning choice for music, event, and emotion recognition tasks. Further, finetuning AT models can also benefit speech-related tasks such as keyword spotting and intent classification.


title: Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

abstract: Language Models pretrained on large textual data have been shown to encode different types of knowledge simultaneously. Traditionally, only the features from the last layer are used when adapting to new tasks or data. We put forward that, when using or finetuning deep pretrained models, intermediate layer features that may be relevant to the downstream task are buried too deep to be used efficiently in terms of needed samples or steps. To test this, we propose a new layer fusion method: Depth-Wise Attention (DWAtt), to help re-surface signals from non-final layers. We compare DWAtt to a basic concatenation-based layer fusion method (Concat), and compare both to a deeper model baseline -- all kept within a similar parameter budget. Our findings show that DWAtt and Concat are more step- and sample-efficient than the baseline, especially in the few-shot setting. DWAtt outperforms Concat on larger data sizes. On CoNLL-03 NER, layer fusion shows 3.68--9.73% F1 gain at different few-shot sizes. The layer fusion models presented significantly outperform the baseline in various training scenarios with different data sizes, architectures, and training constraints.


title: Handle Anywhere: A Mobile Robot Arm for Providing Bodily Support to Elderly Persons

abstract: Age-related loss of mobility and increased risk of falling remain important obstacles toward facilitating aging-in-place. Many elderly people lack the coordination and strength necessary to perform common movements around their home, such as getting out of bed or stepping into a bathtub. The traditional solution has been to install grab bars on various surfaces; however, these are often not placed in optimal locations due to feasibility constraints in room layout. In this paper, we present a mobile robot that provides an older adult with a handle anywhere in space - "handle anywhere". The robot consists of an omnidirectional mobile base attached to a repositionable handle. We analyze the postural changes in four activities of daily living and determine, in each, the body pose that requires the maximal muscle effort. Using a simple model of the human body, we develop a methodology to optimally place the handle to provide the maximum support for the elderly person at the point of most effort. Our model is validated with experimental trials. We discuss how the robotic device could be used to enhance patient mobility and reduce the incidence of falls.