title: Augmentation Strategies for Learning with Noisy Labels

abstract: Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up phase to curate an initial set of cleanly labeled samples, and using the output of a network as a pseudo-label for subsequent loss calculations. In this paper, we evaluate different augmentation strategies for algorithms tackling the "learning with noisy labels" problem. We propose and examine multiple augmentation strategies and evaluate them using synthetic datasets based on CIFAR-10 and CIFAR-100, as well as on the real-world dataset Clothing1M. Due to several commonalities in these algorithms, we find that using one set of augmentations for loss modeling tasks and another set for learning is the most effective, improving results on the state-of-the-art and other previous methods. Furthermore, we find that applying augmentation during the warm-up period can negatively impact the loss convergence behavior of correctly versus incorrectly labeled samples. We introduce this augmentation strategy to the state-of-the-art technique and demonstrate that we can improve performance across all evaluated noise levels. In particular, we improve accuracy on the CIFAR-10 benchmark at 90% symmetric noise by more than 15% in absolute accuracy, and we also improve performance on the Clothing1M dataset. (K. Nishi and Y. Ding contributed equally to this work)


title: VELOC: VEry Low Overhead Checkpointing in the Age of Exascale

abstract: Checkpointing large amounts of related data concurrently to stable storage is a common I/O pattern of many HPC applications. However, such a pattern frequently leads to I/O bottlenecks that lead to poor scalability and performance. As modern HPC infrastructures continue to evolve, there is a growing gap between compute capacity vs. I/O capabilities. Furthermore, the storage hierarchy is becoming increasingly heterogeneous: in addition to parallel file systems, it comprises burst buffers, key-value stores, deep memory hierarchies at node level, etc. In this context, state of art is insufficient to deal with the diversity of vendor APIs, performance and persistency characteristics. This extended abstract presents an overview of VeloC (Very Low Overhead Checkpointing System), a checkpointing runtime specifically design to address these challenges for the next generation Exascale HPC applications and systems. VeloC offers a simple API at user level, while employing an advanced multi-level resilience strategy that transparently optimizes the performance and scalability of checkpointing by leveraging heterogeneous storage.


title: Enantioselection and chiral sorting of single microspheres using optical pulling forces

abstract: We put forward a novel, twofold scheme that enables at the same time all-optical enantioselection and sorting of single multipolar chiral microspheres based on optical pulling forces exerted by two non-collinear, nonstructured, circularly-polarized light sources. Our chiral resolution method can be externally controlled by varying the angle between their incident wavevectors, allowing for a fine-tuning of the range of chiral indices for enantioselection. Enantioselectivity is achieved by choosing angles such that only particles with the same handedness of the light sources are pulled. This proposal allows one to achieve all-optical sorting of chiral microspheres with arbitrarily small chiral parameters, thus outperforming current optical methods.


title: Invariant Subvarieties of Minimal Homological Dimension, Zero Lyapunov Exponents, and Monodromy

abstract: We classify the GL(2,R)-invariant subvarieties M in strata of Abelian differentials for which any two M-parallel cylinders have homologous core curves. This answers a question of Mirzakhani and Wright. As a corollary we show that outside of an explicit list of exceptions, if M is a GL(2,R)-invariant subvariety, then the Kontsevich-Zorich cocycle has nonzero Lyapunov exponents in the symplectic orthogonal of the projection of the tangent bundle of M to absolute cohomology.


title: QoS-Driven Resource Optimization for Intelligent Fog Radio Access Network: A Dynamic Power Allocation Perspective

abstract: The fog radio access network (Fog-RAN) has been considered a promising wireless access architecture to help shorten the communication delay and relieve the large data delivery burden over the backhaul links. However, limited by conventional inflexible communication design, Fog-RAN cannot be used in some complex communication scenarios. In this study, we focus on investigating a more intelligent Fog-RAN to assist the communication in a high-speed railway environment. Due to the train's continuously moving, the communication should be designed intelligently to adapt to channel variation. Specifically, we dynamically optimize the power allocation in the remote radio heads (RRHs) to minimize the total network power cost considering multiple quality-of-service (QoS) requirements and channel variation. The impact of caching on the power allocation is considered. The dynamic power optimization is analyzed to obtain a closed-form solution in certain cases. The inherent tradeoff among the total network cost, delay and delivery content size is further discussed. To evaluate the performance of the proposed dynamic power allocation, we present an invariant power allocation counterpart as a performance comparison benchmark. The result of our simulation reveals that dynamic power allocation can significantly outperform the invariant power allocation scheme, especially with a random caching strategy or limited caching resources at the RRHs.


title: Combinatorial proofs of the Ramanujan type congruences modulo 3

abstract: The partition statistic $V_R$-rank is introduced to give combinatorial proofs of the Ramanujan type congruences mod 3 for certain classes of partition functions.


title: Toward a Scalable Upper Bound for a CVaR-LQ Problem

abstract: We study a linear-quadratic, optimal control problem on a discrete, finite time horizon with distributional ambiguity, in which the cost is assessed via Conditional Value-at-Risk (CVaR). We take steps toward deriving a scalable dynamic programming approach to upper-bound the optimal value function for this problem. This dynamic program yields a novel, tunable risk-averse control policy, which we compare to existing state-of-the-art methods.


title: Leading or Following? Dyadic Robot Imitative Interaction Using the Active Inference Framework

abstract: This study investigated how social interaction among robotic agents changes dynamically depending on the individual belief of action intention. In a set of simulation studies, we examine dyadic imitative interactions of robots using a variational recurrent neural network model. The model is based on the free energy principle such that a pair of interacting robots find themselves in a loop, attempting to predict and infer each other's actions using active inference. We examined how regulating the complexity term to minimize free energy determines the dynamic characteristics of networks and interactions. When one robot trained with tighter regulation and another trained with looser regulation interact, the latter tends to lead the interaction by exerting stronger action intention, while the former tends to follow by adapting to its observations. The study confirms that the dyadic imitative interaction becomes successful by achieving a high synchronization rate when a leader and a follower are determined by developing action intentions with strong belief and weak belief, respectively.


title: Parametric Complexity Bounds for Approximating PDEs with Neural Networks

abstract: Recent experiments have shown that deep networks can approximate solutions to high-dimensional PDEs, seemingly escaping the curse of dimensionality. However, questions regarding the theoretical basis for such approximations, including the required network size, remain open. In this paper, we investigate the representational power of neural networks for approximating solutions to linear elliptic PDEs with Dirichlet boundary conditions. We prove that when a PDE's coefficients are representable by small neural networks, the parameters required to approximate its solution scale polynomially with the input dimension $d$ and proportionally to the parameter counts of the coefficient networks. To this we end, we develop a proof technique that simulates gradient descent (in an appropriate Hilbert space) by growing a neural network architecture whose iterates each participate as sub-networks in their (slightly larger) successors, and converge to the solution of the PDE. We bound the size of the solution, showing a polynomial dependence on $d$ and no dependence on the volume of the domain.


title: Energy and Cost Efficient Resource Allocation for Blockchain-Enabled NFV

abstract: Network function virtualization (NFV) is a promising technology to make 5G networks flexible and agile. NFV decreases operators' OPEX and CAPEX by decoupling the physical hardware from the functions they perform. In NFV, users' service request can be viewed as a service function chain (SFC) consisting of several virtual network functions (VNFs) which are connected through virtual links. Resource allocation in NFV is done through a centralized authority called NFV Orchestrator (NFVO). This centralized authority suffers from some drawbacks such as single point of failure and security. Blockchain (BC) technology is able to address these problems by decentralizing resource allocation. The drawbacks of NFVO in NFV architecture and the exceptional BC characteristics to address these problems motivate us to focus on NFV resource allocation to users' SFCs without the need for an NFVO based on BC technology. To this end, we assume there are two types of users: users who send SFC requests (SFC requesting users) and users who perform mining process (miner users). For SFC requesting users, we formulate NFV resource allocation (NFV-RA) problem as a multi-objective problem to minimize the energy consumption and utilized resource cost, simultaneously.


title: PML: Progressive Margin Loss for Long-tailed Age Classification

abstract: In this paper, we propose a progressive margin loss (PML) approach for unconstrained facial age classification. Conventional methods make strong assumption on that each class owns adequate instances to outline its data distribution, likely leading to bias prediction where the training samples are sparse across age classes. Instead, our PML aims to adaptively refine the age label pattern by enforcing a couple of margins, which fully takes in the in-between discrepancy of the intra-class variance, inter-class variance and class center. Our PML typically incorporates with the ordinal margin and the variational margin, simultaneously plugging in the globally-tuned deep neural network paradigm. More specifically, the ordinal margin learns to exploit the correlated relationship of the real-world age labels. Accordingly, the variational margin is leveraged to minimize the influence of head classes that misleads the prediction of tailed samples. Moreover, our optimization carefully seeks a series of indicator curricula to achieve robust and efficient model training. Extensive experimental results on three face aging datasets demonstrate that our PML achieves compelling performance compared to state of the arts. Code will be made publicly.


title: CogNet: Bridging Linguistic Knowledge, World Knowledge and Commonsense Knowledge

abstract: In this paper, we present CogNet, a knowledge base (KB) dedicated to integrating three types of knowledge: (1) linguistic knowledge from FrameNet, which schematically describes situations, objects and events. (2) world knowledge from YAGO, Freebase, DBpedia and Wikidata, which provides explicit knowledge about specific instances. (3) commonsense knowledge from ConceptNet, which describes implicit general facts. To model these different types of knowledge consistently, we introduce a three-level unified frame-styled representation architecture. To integrate free-form commonsense knowledge with other structured knowledge, we propose a strategy that combines automated labeling and crowdsourced annotation. At present, CogNet integrates 1,000+ semantic frames from linguistic KBs, 20,000,000+ frame instances from world KBs, as well as 90,000+ commonsense assertions from commonsense KBs. All these data can be easily queried and explored on our online platform, and free to download in RDF format for utilization under a CC-BY-SA 4.0 license. The demo and data are available at http://cognet.top/.


title: Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control

abstract: Robotic simulators are crucial for academic research and education as well as the development of safety-critical applications. Reinforcement learning environments -- simple simulations coupled with a problem specification in the form of a reward function -- are also important to standardize the development (and benchmarking) of learning algorithms. Yet, full-scale simulators typically lack portability and parallelizability. Vice versa, many reinforcement learning environments trade-off realism for high sample throughputs in toy-like problems. While public data sets have greatly benefited deep learning and computer vision, we still lack the software tools to simultaneously develop -- and fairly compare -- control theory and reinforcement learning approaches. In this paper, we propose an open-source OpenAI Gym-like environment for multiple quadcopters based on the Bullet physics engine. Its multi-agent and vision based reinforcement learning interfaces, as well as the support of realistic collisions and aerodynamic effects, make it, to the best of our knowledge, a first of its kind. We demonstrate its use through several examples, either for control (trajectory tracking with PID control, multi-robot flight with downwash, etc.) or reinforcement learning (single and multi-agent stabilization tasks), hoping to inspire future research that combines control theory and machine learning.


title: Random Feature Attention

abstract: Transformers are state-of-the-art models for a variety of sequence modeling tasks. At their core is an attention function which models pairwise interactions between the inputs at every timestep. While attention is powerful, it does not scale efficiently to long sequences due to its quadratic time and space complexity in the sequence length. We propose RFA, a linear time and space attention that uses random feature methods to approximate the softmax function, and explore its application in transformers. RFA can be used as a drop-in replacement for conventional softmax attention and offers a straightforward way of learning with recency bias through an optional gating mechanism. Experiments on language modeling and machine translation demonstrate that RFA achieves similar or better performance compared to strong transformer baselines. In the machine translation experiment, RFA decodes twice as fast as a vanilla transformer. Compared to existing efficient transformer variants, RFA is competitive in terms of both accuracy and efficiency on three long text classification datasets. Our analysis shows that RFA's efficiency gains are especially notable on long sequences, suggesting that RFA will be particularly useful in tasks that require working with large inputs, fast decoding speed, or low memory footprints.


title: Two-Stage Framework for Seasonal Time Series Forecasting

abstract: Seasonal time series Forecasting remains a challenging problem due to the long-term dependency from seasonality. In this paper, we propose a two-stage framework to forecast univariate seasonal time series. The first stage explicitly learns the long-range time series structure in a time window beyond the forecast horizon. By incorporating the learned long-range structure, the second stage can enhance the prediction accuracy in the forecast horizon. In both stages, we integrate the auto-regressive model with neural networks to capture both linear and non-linear characteristics in time series. Our framework achieves state-of-the-art performance on M4 Competition Hourly datasets. In particular, we show that incorporating the intermediate results generated in the first stage to existing forecast models can effectively enhance their prediction performance.


title: Enhancing the Interactivity of Dataframe Queries by Leveraging Think Time

abstract: We propose opportunistic evaluation, a framework for accelerating interactions with dataframes. Interactive latency is critical for iterative, human-in-the-loop dataframe workloads for supporting exploratory data analysis. Opportunistic evaluation significantly reduces interactive latency by 1) prioritizing computation directly relevant to the interactions and 2) leveraging think time for asynchronous background computation for non-critical operators that might be relevant to future interactions. We show, through empirical analysis, that current user behavior presents ample opportunities for optimization, and the solutions we propose effectively harness such opportunities.


title: Fast Security Evaluation for Operation of Water Distribution Systems Against Extreme Conditions

abstract: This paper defines a security injection region (SIR) to guarantee reliable operation of water distribution systems (WDS) under extreme conditions. The model of WDSs is highly nonlinear and nonconvex. Understanding the accurate SIRs of WDSs involves the analysis of nonlinear constraints, which is computationally expensive. To reduce the computational burden, this paper first investigates the convexity of the SIR of WDSs under certain conditions. Then, an algorithm based on a monotone inner polytope sequence is proposed to effectively and accurately determine these SIRs. The proposed algorithm estimates a sequence of inner polytopes that converge to the whole convex region. Each polytope adds a new area to the SIR. The algorithm is validated on two different WDSs, and the conclusion is drawn. The computational study shows this method is applicable and fast for both systems.


title: Reverb Conversion of Mixed Vocal Tracks Using an End-to-end Convolutional Deep Neural Network

abstract: Reverb plays a critical role in music production, where it provides listeners with spatial realization, timbre, and texture of the music. Yet, it is challenging to reproduce the musical reverb of a reference music track even by skilled engineers. In response, we propose an end-to-end system capable of switching the musical reverb factor of two different mixed vocal tracks. This method enables us to apply the reverb of the reference track to the source track to which the effect is desired. Further, our model can perform de-reverberation when the reference track is used as a dry vocal source. The proposed model is trained in combination with an adversarial objective, which makes it possible to handle high-resolution audio samples. The perceptual evaluation confirmed that the proposed model can convert the reverb factor with the preferred rate of 64.8%. To the best of our knowledge, this is the first attempt to apply deep neural networks to converting music reverb of vocal tracks.


title: Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learning

abstract: Fast and accurate reconstruction of magnetic resonance (MR) images from under-sampled data is important in many clinical applications. In recent years, deep learning-based methods have been shown to produce superior performance on MR image reconstruction. However, these methods require large amounts of data which is difficult to collect and share due to the high cost of acquisition and medical data privacy regulations. In order to overcome this challenge, we propose a federated learning (FL) based solution in which we take advantage of the MR data available at different institutions while preserving patients' privacy. However, the generalizability of models trained with the FL setting can still be suboptimal due to domain shift, which results from the data collected at multiple institutions with different sensors, disease types, and acquisition protocols, etc. With the motivation of circumventing this challenge, we propose a cross-site modeling for MR image reconstruction in which the learned intermediate latent features among different source sites are aligned with the distribution of the latent features at the target site. Extensive experiments are conducted to provide various insights about FL for MR image reconstruction. Experimental results demonstrate that the proposed framework is a promising direction to utilize multi-institutional data without compromising patients' privacy for achieving improved MR image reconstruction. Our code will be available at https://github.com/guopengf/FLMRCM.


title: Organic single crystal phototransistors: Recent approaches and achievements

abstract: Organic phototransistors (OPTs), compared to traditional inorganic counterparts, have attracted a great deal of interest because of their inherent flexibility, light-weight, easy and low-cost fabrication, and are considered as potential candidates for next-generation wearable electronics. Currently, significant advances have been made in OPTs with the development of new organic semiconductors and optimization of device fabrication protocols. Among various types of OPTs, small molecule organic single crystal phototransistors (OSCPTs) standout because of their exciting features, such as long exciton diffusion length and high charge carrier mobility relative to organic thinfilm phototransistors. In this review, a brief introduction to device architectures, working mechanisms and figure of merits for OPTs is presented. We then overview recent approaches employed and achievements made for the development of OSCPTs. Finally, we spotlight potential future directions to tackle the existing challenges in this field and accelerate the advancement of OSCPTs towards practical applications.


title: Inference-Based Deterministic Messaging For Multi-Agent Communication

abstract: Communication is essential for coordination among humans and animals. Therefore, with the introduction of intelligent agents into the world, agent-to-agent and agent-to-human communication becomes necessary. In this paper, we first study learning in matrix-based signaling games to empirically show that decentralized methods can converge to a suboptimal policy. We then propose a modification to the messaging policy, in which the sender deterministically chooses the best message that helps the receiver to infer the sender's observation. Using this modification, we see, empirically, that the agents converge to the optimal policy in nearly all the runs. We then apply this method to a partially observable gridworld environment which requires cooperation between two agents and show that, with appropriate approximation methods, the proposed sender modification can enhance existing decentralized training methods for more complex domains as well.


title: Property investigation for different wedge-shaped CsI(Tl)s

abstract: Two types of wedge-shaped CsI(Tl)s were designed to be placed behind the annular double-sided silicon detectors (ADSSDs) to identify the light charged particles with the $\Delta E-E$ method. The properties of CsI(Tl)s with different shapes and sizes, such as energy resolution, light output non-uniformity and particle identification capability, were compared by using a $\alpha$-source and a radioactive beam of $^{15}$C. The big-size CsI(Tl) was finally adopted to form the $\Delta E-E$ telescope due to better properties. The property differences of these two types of CsI(Tl)s can be interpreted based on the Geant4 simulation results.


title: Group-wise Inhibition based Feature Regularization for Robust Classification

abstract: The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative regions, but ignores the auxiliary features when learning, leading to the lack of feature diversity for final judgment. In our method, we propose to dynamically suppress significant activation values of CNN by group-wise inhibition, but not fixedly or randomly handle them when training. The feature maps with different activation distribution are then processed separately to take the feature independence into account. CNN is finally guided to learn richer discriminative features hierarchically for robust classification according to the proposed regularization. Our method is comprehensively evaluated under multiple settings, including classification against corruptions, adversarial attacks and low data regime. Extensive experimental results show that the proposed method can achieve significant improvements in terms of both robustness and generalization performances, when compared with the state-of-the-art methods. Code is available at https://github.com/LinusWu/TENET_Training.


title: Degree of Orthomorphism Polynomials over Finite Fields

abstract: An orthomorphism over a finite field $\mathbb{F}_q$ is a permutation $\theta:\mathbb{F}_q\mapsto\mathbb{F}_q$ such that the map $x\mapsto\theta(x)-x$ is also a permutation of $\mathbb{F}_q$. The degree of an orthomorphism of $\mathbb{F}_q$, that is, the degree of the associated reduced permutation polynomial, is known to be at most $q-3$. We show that this upper bound is achieved for all prime powers $q\notin\{2, 3, 5, 8\}$. We do this by finding two orthomorphisms in each field that differ on only three elements of their domain. Such orthomorphisms can be used to construct $3$-homogeneous Latin bitrades.


title: Convergence of random attractors towards deterministic singleton attractor for 2D and 3D convective Brinkman-Forchheimer equations

abstract: This work deals with the asymptotic behavior of the two as well as three dimensional convective Brinkman-Forchheimer (CBF) equations in periodic domains: $$\frac{\partial\boldsymbol{u}}{\partial t}-\mu \Delta\boldsymbol{u}+(\boldsymbol{u}\cdot\nabla)\boldsymbol{u}+\alpha\boldsymbol{u}+\beta|\boldsymbol{u}|^{r-1}\boldsymbol{u}+\nabla p=\boldsymbol{f},\ \nabla\cdot\boldsymbol{u}=0,$$ where $r\geq1$. We prove that the global attractor of the above system is a singleton under small forcing intensity ($r\geq 1$ for $n=2$ and $r\geq 3$ for $n=3$ with $2\beta\mu\geq 1$ for $r=n=3$). After perturbing the above system with additive or multiplicative white noise, the random attractor does not have a singleton structure. But we obtain that the random attractor for 2D stochastic CBF equations with additive and multiplicative white noise converges towards the deterministic singleton attractor for $1\leq r\leq 2$ and $1\leq r<\infty$, respectively, when the coefficient of random perturbation converges to zero (upper and lower semicontinuity). Interestingly in the case of 3D stochastic CBF equations perturbed by multiplicative white noise, we are able to establish that the random attractor converges towards the deterministic singleton attractor for $3\leq r\leq 5$ ($2\beta\mu\geq 1$ for $r=3$), when the coefficient of random perturbation converges to zero.


title: Sensing population distribution from satellite imagery via deep learning: model selection, neighboring effect, and systematic biases

abstract: The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This study marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this study provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery.


title: Ridge-penalized adaptive Mantel test and its application in imaging genetics

abstract: We propose a ridge-penalized adaptive Mantel test (AdaMant) for evaluating the association of two high-dimensional sets of features. By introducing a ridge penalty, AdaMant tests the association across many metrics simultaneously. We demonstrate how ridge penalization bridges Euclidean and Mahalanobis distances and their corresponding linear models from the perspective of association measurement and testing. This result is not only theoretically interesting but also has important implications in penalized hypothesis testing, especially in high dimensional settings such as imaging genetics. Applying the proposed method to an imaging genetic study of visual working memory in health adults, we identified interesting associations of brain connectivity (measured by EEG coherence) with selected genetic features.


title: A Deep and Wide Neural Network-based Model for Rajasthan Summer Monsoon Rainfall (RSMR) Prediction

abstract: Importance of monsoon rainfall cannot be ignored as it affects round the year activities ranging from agriculture to industrial. Accurate rainfall estimation and prediction is very helpful in decision making in the sectors of water resource management and agriculture. Due to dynamic nature of monsoon rainfall, it's accurate prediction becomes very challenging task. In this paper, we analyze and evaluate various deep learning approaches such as one dimensional Convolutional Neutral Network, Multi-layer Perceptron and Wide Deep Neural Networks for the prediction of summer monsoon rainfall in Indian state of Rajasthan.For our analysis purpose we have used two different types of datasets for our experiments. From IMD grided dataset, rainfall data of 484 coordinates are selected which lies within the geographical boundaries of Rajasthan. We have also collected rainfall data of 158 rain gauge station from water resources department. The comparison of various algorithms on both these data sets is presented in this paper and it is found that Deep Wide Neural Network based model outperforms the other two approaches.


title: Homogeneous Linear Ion Crystal in a Hybrid Potential

abstract: We investigate the properties of a linear ion crystal in a combination of quadratic and quartic potentials. Both the discrete and the continuous model are employed to explore the homogeneity of a linear ion crystal by controlling the proportional parameter between the quadratic and quartic components. It is found that a uniform ion distribution in such a hybrid potential can be made larger than that in a purely quadratic or quartic potential. The zigzag transition is also investigated in the hybrid potential. Its critical condition and phase diagram are determined numerically, which agrees well with previous theoretical and experimental results. This paves the way for experimental investigation of phase transition in a large linear coulomb crystal.


title: Towards the three-dimensional parton structure of the pion: Integrating transverse momentum data into global QCD analysis

abstract: We perform a new Monte Carlo QCD analysis of pion parton distribution functions, including, for the first time, transverse momentum dependent pion-nucleus Drell-Yan cross sections together with $p_{\rm T}$-integrated Drell-Yan and leading neutron electroproduction data from HERA. We assess the sensitivity of the Monte Carlo fits to kinematic cuts, factorization scale, and parametrization choice, and we discuss the impact of the various datasets on the pion's quark and gluon distributions. This study provides the necessary step towards the simultaneous analysis of collinear and transverse momentum dependent pion distributions and the determination of the pion's three-dimensional structure.


title: Off-Chain Micropayment Pool for High-ThroughputBandwidth Sharing Rewards

abstract: This paper presents a layer-2 micropayment pool design which supports high-throughput blockchain off-chain payment, designed specifically for the use case of rewarding users who share redundant bandwidth to assist video stream delivery. We analyze the validity and effectiveness of the proposed micropayment pool. Our analysis results demonstrate that the proposed micropayment pool design is better suited for the bandwidth reward use case compared to existing off-chain payment channel solution.


title: A low-mass dark matter project, ALETHEIA: A Liquid hElium Time projection cHambEr In dArk matter

abstract: Dark Matter (DM) is one of the most critical questions to be understood and answered in fundamental physics today. Observations with varied astronomical and cosmological technologies already pinned down that DM exists in the Universe, the Milky Way, and the Solar System. However, the understanding of DM under the language of elementary physics is still in progress. DM direct detection aims to test the interactive cross-section between galactic DM particles and an underground detector's nucleons. Although Weakly Interactive Massive Particles (WIMPs) is the most discussed DM candidate, the null-WIMPs conclusion has been consistently addressed by most convincing experiments in the field. The low-mass WIMPs region (100s MeV/c$^2$ - 10 GeV/c$^2$) has not been fully exploited comparing to high-mass WIMPs (10 GeV/c$^2$ - 1 TeV/c$^2$) experiments which implement liquid xenon or argon TPCs (Time Projection Chambers). The ALETHEIA experiment aims to hunt for low-mass WIMPs with liquid helium-filled TPCs. In this paper, we go through the physics motivation of low-mass DM, the ALETHEIA detector's design, a series of R&D programs that should be launched to address a liquid helium TPC's functionality, and possible analysis channels available for DM searches. We designed and homemade a 30 g liquid helium prototype detector at CIAE. In Summer 2021, the detector was cooled down to 4.5 K successfully. The detector's dark current is less than ten pA for an external voltage up to 17 kV/cm when filled with vacuum, 1 atm nitrogen gas, and liquid nitrogen.


title: Predicting Driver Fatigue in Automated Driving with Explainability

abstract: Research indicates that monotonous automated driving increases the incidence of fatigued driving. Although many prediction models based on advanced machine learning techniques were proposed to monitor driver fatigue, especially in manual driving, little is known about how these black-box machine learning models work. In this paper, we proposed a combination of eXtreme Gradient Boosting (XGBoost) and SHAP (SHapley Additive exPlanations) to predict driver fatigue with explanations due to their efficiency and accuracy. First, in order to obtain the ground truth of driver fatigue, PERCLOS (percentage of eyelid closure over the pupil over time) between 0 and 100 was used as the response variable. Second, we built a driver fatigue regression model using both physiological and behavioral measures with XGBoost and it outperformed other selected machine learning models with 3.847 root-mean-squared error (RMSE), 1.768 mean absolute error (MAE) and 0.996 adjusted $R^2$. Third, we employed SHAP to identify the most important predictor variables and uncovered the black-box XGBoost model by showing the main effects of most important predictor variables globally and explaining individual predictions locally. Such an explainable driver fatigue prediction model offered insights into how to intervene in automated driving when necessary, such as during the takeover transition period from automated driving to manual driving.


title: To Deconvolve, or Not to Deconvolve: Inferences of Neuronal Activities using Calcium Imaging Data

abstract: With the increasing popularity of calcium imaging data in neuroscience research, methods for analyzing calcium trace data are critical to address various questions. The observed calcium traces are either analyzed directly or deconvolved to spike trains to infer neuronal activities. When both approaches are applicable, it is unclear whether deconvolving calcium traces is a necessary step. In this article, we compare the performance of using calcium traces or their deconvolved spike trains for three common analyses: clustering, principal component analysis (PCA), and population decoding. Our simulations and applications to real data suggest that the estimated spike data outperform calcium trace data for both clustering and PCA. Although calcium trace data show higher predictability than spike data at each time point, spike history or cumulative spike counts is comparable to or better than calcium traces in population decoding.


title: Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Series

abstract: Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging applications. However, most existing methods process MTS's individually, and do not leverage the dynamic distributions underlying the MTS's, leading to sub-optimal results when the sparsity is high. To address this challenge, we propose a novel generative model, which tracks the transition of latent clusters, instead of isolated feature representations, to achieve robust modeling. It is characterized by a newly designed dynamic Gaussian mixture distribution, which captures the dynamics of clustering structures, and is used for emitting timeseries. The generative model is parameterized by neural networks. A structured inference network is also designed for enabling inductive analysis. A gating mechanism is further introduced to dynamically tune the Gaussian mixture distributions. Extensive experimental results on a variety of real-life datasets demonstrate the effectiveness of our method.


title: Parsimonious Inference

abstract: Bayesian inference provides a uniquely rigorous approach to obtain principled justification for uncertainty in predictions, yet it is difficult to articulate suitably general prior belief in the machine learning context, where computational architectures are pure abstractions subject to frequent modifications by practitioners attempting to improve results. Parsimonious inference is an information-theoretic formulation of inference over arbitrary architectures that formalizes Occam's Razor; we prefer simple and sufficient explanations. Our universal hyperprior assigns plausibility to prior descriptions, encoded as sequences of symbols, by expanding on the core relationships between program length, Kolmogorov complexity, and Solomonoff's algorithmic probability. We then cast learning as information minimization over our composite change in belief when an architecture is specified, training data are observed, and model parameters are inferred. By distinguishing model complexity from prediction information, our framework also quantifies the phenomenon of memorization. Although our theory is general, it is most critical when datasets are limited, e.g. small or skewed. We develop novel algorithms for polynomial regression and random forests that are suitable for such data, as demonstrated by our experiments. Our approaches combine efficient encodings with prudent sampling strategies to construct predictive ensembles without cross-validation, thus addressing a fundamental challenge in how to efficiently obtain predictions from data.


title: Electrochemical Modeling of Calendar Capacity Loss of Nickel-Manganese-Cobalt (NMC)-Graphite Lithium Ion Batteries

abstract: Li-ion batteries with nickel-manganese-cobalt (NMC) cathode and graphite anode are popularly used in portable electronic devices and electric vehicles. Calendar loss of the lithium ion battery is a dominating factor in battery degradation. However, few modeling work was reported on studying the calendar capacity loss of NMC-graphite Li-ion batteries. In this work, an electrochemical model for NMC-graphite Li-ion battery was developed to investigate its calendar loss behavior. Various factors affecting the calendar loss of the NMC-graphite batteries were systematically investigated, with the results validated with experimental data of a Sanyo 18,650 cylindrical cell. It was found that at 25 o C working temperature and 100% SOC, the capacity drops 6.4% of its original capacity after 10 months. Also, when the anode particle size decreases from 26.2 {\mu}m to 6.55 {\mu}m, the capacity drop ratio is over 22% after 10 months under the same operation condition. Our simulation results demonstrate that a smaller SOC, a lower cell working temperature and a larger particle size could prolong the battery life during the storage period. This modeling work can help better understand the calendar loss behavior of NMC-graphite Li-ion batteries, and serve as a robust reference for the battery performance optimization in future.


title: Touchless Palmprint Recognition based on 3D Gabor Template and Block Feature Refinement

abstract: With the growing demand for hand hygiene and convenience of use, palmprint recognition with touchless manner made a great development recently, providing an effective solution for person identification. Despite many efforts that have been devoted to this area, it is still uncertain about the discriminative ability of the contactless palmprint, especially for large-scale datasets. To tackle the problem, in this paper, we build a large-scale touchless palmprint dataset containing 2334 palms from 1167 individuals. To our best knowledge, it is the largest contactless palmprint image benchmark ever collected with regard to the number of individuals and palms. Besides, we propose a novel deep learning framework for touchless palmprint recognition named 3DCPN (3D Convolution Palmprint recognition Network) which leverages 3D convolution to dynamically integrate multiple Gabor features. In 3DCPN, a novel variant of Gabor filter is embedded into the first layer for enhancement of curve feature extraction. With a well-designed ensemble scheme,low-level 3D features are then convolved to extract high-level features. Finally on the top, we set a region-based loss function to strengthen the discriminative ability of both global and local descriptors. To demonstrate the superiority of our method, extensive experiments are conducted on our dataset and other popular databases TongJi and IITD, where the results show the proposed 3DCPN achieves state-of-the-art or comparable performances.


title: Symmetric permutation invariants in some tensor products

abstract: This is a note for constructing fundamental invariants and computing the Hilbert series of the invariant subalgebras of tensor products of polynomial rings under the action by a direct product of symmetric groups. Our computation relies on Schur functions bringing together several identities of combinatorial generating functions including that of plane partitions.


title: Real Time Vigilance Detection using Frontal EEG

abstract: Vigilance of an operator is compromised in performing many monotonous activities like workshop and manufacturing floor tasks, driving, night shift workers, flying, and in general any activity which requires keen attention of an individual over prolonged periods of time. Driver or operator fatigue in these situations leads to drowsiness and lowered vigilance which is one of the largest contributors to injuries and fatalities amongst road accidents or workshop floor accidents. Having a vigilance monitoring system to detect drop in vigilance in these situations becomes very important. This paper presents a system which uses non-invasively recorded Frontal EEG from an easy-to-use commercially available Brain Computer Interface wearable device to determine the vigilance state of an individual. The change in the power spectrum in the Frontal Theta Band (4-8Hz) of an individual's brain wave predicts the changes in the attention level of an individual - providing an early detection and warning system. This method provides an accurate, yet cheap and practical system for vigilance monitoring across different environments.


title: Constraints on running vacuum models with the baryon-to-photon ratio

abstract: We study the influence of running vacuum on the baryon-to-photon ratio in running vacuum models (RVMs). When there exists a non-minimal coupling between photons and other matter in the expanding universe, the energy-momentum tensor of photons is no longer conserved, but the energy of photons could remain conserved. We discuss the conditions for the energy conservation of photons in RVMs. The photon number density and baryon number density, from the epoch of photon decoupling to the present day, are obtained in the context of RVMs by assuming that photons and baryons can be coupled to running vacuum, respectively. Both cases lead to a time-evolving baryon-to-photon ratio. However the evolution of the baryon-to-photon ratio is strictly constrained by observations. It is found that if the dynamic term of running vacuum is indeed coupled to photons or baryons, the coefficient of the dynamic term must be extremely small, which is unnatural. Therefore, our study basically rules out the possibility that running vacuum is coupled to photons or baryons in RVMs.


title: An Axiomatic Approach to Detect Information Leaks in Concurrent Programs

abstract: Realizing flow security in a concurrent environment is extremely challenging, primarily due to non-deterministic nature of execution. The difficulty is further exacerbated from a security angle if sequential threads disclose control locations through publicly observable statements like print, sleep, delay, etc. Such observations lead to internal and external timing attacks. Inspired by previous works that use classical Hoare style proof systems for establishing correctness of distributed (real-time) programs, in this paper, we describe a method for finding information leaks in concurrent programs through the introduction of leaky assertions at observable program points. Specifying leaky assertions akin to classic assertions, we demonstrate how information leaks can be detected in a concurrent context. To our knowledge, this is the first such work that enables integration of different notions of non-interference used in functional and security context. While the approach is sound and relatively complete in the classic sense, it enables the use of algorithmic techniques that enable programmers to come up with leaky assertions that enable checking for information leaks in sensitive applications.


title: Unbounded negativity on rational surfaces in positive characteristic

abstract: We give explicit blowups of the projective plane in positive characteristic that contain smooth rational curves of arbitrarily negative self-intersection, showing that the Bounded Negativity Conjecture fails even for rational surfaces in positive characteristic.


title: Two Modes of Cluster Dynamics Govern the Viscoelasticity of Colloidal Gels

abstract: Colloidal gels formed by strongly attractive particles at low particle volume fractions are composed of space-spanning networks of uniformly sized clusters. We study the thermal fluctuations of the clusters using differential dynamic microscopy by decomposing them into two modes of dynamics, and link them to the macroscopic viscoelasticity via rheometry. The first mode, dominant at early times, represents the localized, elastic fluctuations of individual clusters. The second mode, pronounced at late times, reflects the collective, viscoelastic dynamics facilitated by the connectivity of the clusters. By mixing two types of particles of distinct attraction strengths in different proportions, we control the transition time at which the collective mode starts to dominate, and hence tune the frequency dependence of the linear viscoelastic moduli of the binary gels.


title: Dynamic Offloading Loading Optimization in distributed Fault Diagnosis system with Deep Reinforcement Learning Approach

abstract: Artificial intelligence and distributed algorithms have been widely used in mechanical fault diagnosis with the explosive growth of diagnostic data. A novel intelligent fault diagnosis system framework that allows intelligent terminals to offload computational tasks to Mobile edge computing (MEC) servers is provided in this paper, which can effectively address the problems of task processing delays and enhanced computational complexity. As the resources at the MEC and intelligent terminals are limited, performing reasonable resource allocation optimization can improve the performance, especially for a multi-terminals offloading system. In this study, to minimize the task computation delay, we jointly optimize the local content splitting ratio, the transmission/computation power allocation, and the MEC server selection under a dynamic environment with stochastic task arrivals. The challenging dynamic joint optimization problem is formulated as a reinforcement learning (RL) problem, which is designed as the computational offloading policies to minimize the long-term average delay cost. Two deep RL strategies, deep Q-learning network (DQN) and deep deterministic policy gradient (DDPG), are adopted to learn the computational offloading policies adaptively and efficiently. The proposed DQN strategy takes the MEC selection as a unique action while using the convex optimization approach to obtain the local content splitting ratio and the transmission/computation power allocation. Simultaneously, the actions of the DDPG strategy are selected as all dynamic variables, including the local content splitting ratio, the transmission/computation power allocation, and the MEC server selection. Numerical results demonstrate that both proposed strategies perform better than the traditional non-learning schemes.


title: Analytical estimation of maximum fraction of infected individuals with one-shot non-pharmaceutical intervention in a hybrid epidemic model

abstract: Facing a global epidemic of new infectious diseases such as COVID-19, non-pharmaceutical interventions (NPIs), which reduce transmission rates without medical actions, are being implemented around the world to mitigate spreads. One of the problems in assessing the effects of NPIs is that different NPIs have been implemented at different times based on the situation of each country; therefore, few assumptions can be shared about how the introduction of policies affects the patient population. Mathematical models can contribute to further understanding these phenomena by obtaining analytical solutions as well as numerical simulations. In this study, an NPI was introduced into the SIR model for a conceptual study of infectious diseases under the condition that the transmission rate was reduced to a fixed value only once within a finite time duration, and its effect was analyzed numerically and theoretically. It was analytically shown that the maximum fraction of infected individuals and the final size could be larger if the intervention starts too early. The analytical results also suggested that more individuals may be infected at the peak of the second wave with a stronger intervention. This study provides quantitative relationship between the strength of a one-shot intervention and the reduction in the number of patients with no approximation. This suggests the importance of the strength and time of NPIs, although detailed studies are necessary for the implementation of NPIs in complicated real-world environments as the model used in this study is based on various simplifications.


title: Towards Fully Intelligent Transportation through Infrastructure-Vehicle Cooperative Autonomous Driving: Challenges and Opportunities

abstract: The infrastructure-vehicle cooperative autonomous driving approach depends on the cooperation between intelligent roads and intelligent vehicles. This approach is not only safer but also more economical compared to the traditional on-vehicle-only autonomous driving approach. In this paper, we introduce our real-world deployment experiences of cooperative autonomous driving, and delve into the details of new challenges and opportunities. Specifically, based on our progress towards commercial deployment, we follow a three-stage development roadmap of the cooperative autonomous driving approach:infrastructure-augmented autonomous driving (IAAD), infrastructure-guided autonomous driving (IGAD), and infrastructure-planned autonomous driving (IPAD).


title: How to Safely Use Extensionality in Liquid Haskell

abstract: Refinement type checkers are a powerful way to reason about functional programs. For example, one can prove properties of a slow, specification implementation, porting the proofs to an optimized implementation that behaves the same. Without functional extensionality, proofs must relate functions that are fully applied. When data itself has a higher-order representation, fully applied proofs face serious impediments! When working with first-order data, fully applied proofs lead to noisome duplication when using higher-order functions. While dependent type theories are typically consistent with functional extensionality axioms, refinement type systems with semantic subtyping treat naive phrasings of functional extensionality inconsistently, leading to unsoundness. We demonstrate this unsoundness and develop a new approach to equality in Liquid Haskell: we define a propositional equality in a library we call PEq. Using PEq avoids the unsoundness while still proving useful equalities at higher types; we demonstrate its use in several case studies. We validate PEq by building a small model and developing its metatheory. Additionally, we prove metaproperties of PEq inside Liquid Haskell itself using an unnamed folklore technique, which we dub `classy induction'.


title: Toward a Larger Sample of Radio Jets from Quiescent Black Hole X-ray Binaries

abstract: Quiescent black hole X-ray binaries (X-ray luminosities <1e34 erg/s) are believed to be fed by hot accretion flows that launch compact, relativistic jets. However, due to their low luminosities, quiescent jets have been detected in the radio waveband from only five systems so far. Here, we present radio observations of two quiescent black hole X-ray binaries with the Australia Telescope Compact Array. One system, GS 1124-684, was not detected. The other system, BW Cir, was detected over two different epochs in 2018 and 2020, for which we also obtained quasi-simultaneous X-ray detections with Chandra and Swift. BW Cir is now the sixth quiescent X-ray binary with a confirmed radio jet. However, the distance to BW Cir is uncertain, and we find that BW Cir shows different behaviour in the radio/X-ray luminosity plane depending on the correct distance. Estimates based on its G-type subgiant donor star place BW Cir at >25 kpc, while initial optical astrometric measurements from Gaia Data Release 2 suggested likely distances of just a few kpc. Here, we use the most recent measurements from Gaia Early Data Release 3 and find a distance d=7.1(+4.8/-3.9) kpc and a potential kick velocity PKV=165(+81/-17) km/s, with distances up to ~20 kpc possible based on its parallax and proper motion. Even though there is now less tension between the parallax and donor-star based distance measurements, it remains an unresolved matter, and we conclude with suggestions on how to reconcile the two measurements.


title: Constructing equivalence bimodules between noncommutative solenoids: a two-pronged approach

abstract: We revisit and generalize the application of a method introduced by Latr\'emoli\`ere and Packer for constructing finitely generated projective modules over the noncommutative solenoid C*-algebras. By realizing them as direct limits of rotation algebras, the method constructs directed systems of equivalence bimodules between rotation algebras that satisfy the necessary compatibility conditions to build Morita equivalence bimodules between the direct limit C*-algebras. In the irrational case, we use a fixed projection in a matrix algebra over the rotation algebra satisfying a key condition to build an equivalence bimodule at each stage following a construction of Rieffel. From this, our main result shows that two irrational noncommutative solenoids are Morita equivalent if and only if such a projection exists. We also make additional observations about the Heisenberg bimodules construction studied by the aforementioned two authors and connect the two constructions.


title: Bounded cohomology property on a smooth projective surface with Picard number two

abstract: We say a smooth projective surface $X$ satisfies the bounded cohomology property if there exists a positive constant $c_X$ such that $h^1(\mathcal O_X(C))\le c_Xh^0(\mathcal O_X(C))$ for every prime divisor $C$ on $X$. Let the closed Mori cone $\mathrm{NE}(X)=\mathbb R_{\ge0}[C_1]+\mathbb R_{\ge0}[C_2]$ such that $C_1$ and $C_2$ with $C_2^2<0$ are some curves on $X$. If either (i) the Kodaira dimension $\kappa(X)\le1$ or (ii) $\kappa(X)=2$, the irregularity $q(X)=0$ and the Iitaka dimension $\kappa(X,C_1)=1$, then we prove that $X$ satisfies the bounded cohomology property.


title: Reflectionless Plasmonic Right-Angled Waveguide Bend and Divider Using Graphene and Transformation Optics

abstract: In this work, a plasmonic right-angled waveguide bend and divider are proposed. Using the Transformation Optics (TO) approach the transformation media of a bend and a T-shaped divider are obtained. Such media with continuous refractive index are realized with the help of graphene in the terahertz frequency range, key to effectively guiding the surface plasmon polariton (SPP) propagation on the 90 degree curves. Components with such capability are promising for THz device applications.


title: Distributed statistical inference with pyhf enabled through funcX

abstract: In High Energy Physics facilities that provide High Performance Computing environments provide an opportunity to efficiently perform the statistical inference required for analysis of data from the Large Hadron Collider, but can pose problems with orchestration and efficient scheduling. The compute architectures at these facilities do not easily support the Python compute model, and the configuration scheduling of batch jobs for physics often requires expertise in multiple job scheduling services. The combination of the pure-Python libraries pyhf and funcX reduces the common problem in HEP analyses of performing statistical inference with binned models, that would traditionally take multiple hours and bespoke scheduling, to an on-demand (fitting) "function as a service" that can scalably execute across workers in just a few minutes, offering reduced time to insight and inference. We demonstrate execution of a scalable workflow using funcX to simultaneously fit 125 signal hypotheses from a published ATLAS search for new physics using pyhf with a wall time of under 3 minutes. We additionally show performance comparisons for other physics analyses with openly published probability models and argue for a blueprint of fitting as a service systems at HPC centers.


title: Auditory Attention Decoding from EEG using Convolutional Recurrent Neural Network

abstract: The auditory attention decoding (AAD) approach was proposed to determine the identity of the attended talker in a multi-talker scenario by analyzing electroencephalography (EEG) data. Although the linear model-based method has been widely used in AAD, the linear assumption was considered oversimplified and the decoding accuracy remained lower for shorter decoding windows. Recently, nonlinear models based on deep neural networks (DNN) have been proposed to solve this problem. However, these models did not fully utilize both the spatial and temporal features of EEG, and the interpretability of DNN models was rarely investigated. In this paper, we proposed novel convolutional recurrent neural network (CRNN) based regression model and classification model, and compared them with both the linear model and the state-of-the-art DNN models. Results showed that, our proposed CRNN-based classification model outperformed others for shorter decoding windows (around 90% for 2 s and 5 s). Although worse than classification models, the decoding accuracy of the proposed CRNN-based regression model was about 5% greater than other regression models. The interpretability of DNN models was also investigated by visualizing layers' weight.


title: RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

abstract: General object grasping is an important yet unsolved problem in the field of robotics. Most of the current methods either generate grasp poses with few DoF that fail to cover most of the success grasps, or only take the unstable depth image or point cloud as input which may lead to poor results in some cases. In this paper, we propose RGBD-Grasp, a pipeline that solves this problem by decoupling 7-DoF grasp detection into two sub-tasks where RGB and depth information are processed separately. In the first stage, an encoder-decoder like convolutional neural network Angle-View Net(AVN) is proposed to predict the SO(3) orientation of the gripper at every location of the image. Consequently, a Fast Analytic Searching(FAS) module calculates the opening width and the distance of the gripper to the grasp point. By decoupling the grasp detection problem and introducing the stable RGB modality, our pipeline alleviates the requirement for the high-quality depth image and is robust to depth sensor noise. We achieve state-of-the-art results on GraspNet-1Billion dataset compared with several baselines. Real robot experiments on a UR5 robot with an Intel Realsense camera and a Robotiq two-finger gripper show high success rates for both single object scenes and cluttered scenes. Our code and trained model will be made publicly available.


title: Task Aligned Generative Meta-learning for Zero-shot Learning

abstract: Zero-shot learning (ZSL) refers to the problem of learning to classify instances from the novel classes (unseen) that are absent in the training set (seen). Most ZSL methods infer the correlation between visual features and attributes to train the classifier for unseen classes. However, such models may have a strong bias towards seen classes during training. Meta-learning has been introduced to mitigate the basis, but meta-ZSL methods are inapplicable when tasks used for training are sampled from diverse distributions. In this regard, we propose a novel Task-aligned Generative Meta-learning model for Zero-shot learning (TGMZ). TGMZ mitigates the potentially biased training and enables meta-ZSL to accommodate real-world datasets containing diverse distributions. TGMZ incorporates an attribute-conditioned task-wise distribution alignment network that projects tasks into a unified distribution to deliver an unbiased model. Our comparisons with state-of-the-art algorithms show the improvements of 2.1%, 3.0%, 2.5%, and 7.6% achieved by TGMZ on AWA1, AWA2, CUB, and aPY datasets, respectively. TGMZ also outperforms competitors by 3.6% in generalized zero-shot learning (GZSL) setting and 7.9% in our proposed fusion-ZSL setting.


title: Eye-gaze Estimation with HEOG and Neck EMG using Deep Neural Networks

abstract: Hearing-impaired listeners usually have troubles attending target talker in multi-talker scenes, even with hearing aids (HAs). The problem can be solved with eye-gaze steering HAs, which requires listeners eye-gazing on the target. In a situation where head rotates, eye-gaze is subject to both behaviors of saccade and head rotation. However, existing methods of eye-gaze estimation did not work reliably, since the listener's strategy of eye-gaze varies and measurements of the two behaviors were not properly combined. Besides, existing methods were based on hand-craft features, which could overlook some important information. In this paper, a head-fixed and a head-free experiments were conducted. We used horizontal electrooculography (HEOG) and neck electromyography (NEMG), which separately measured saccade and head rotation to commonly estimate eye-gaze. Besides traditional classifier and hand-craft features, deep neural networks (DNN) were introduced to automatically extract features from intact waveforms. Evaluation results showed that when the input was HEOG with inertial measurement unit, the best performance of our proposed DNN classifiers achieved 93.3%; and when HEOG was with NEMG together, the accuracy reached 72.6%, higher than that with HEOG (about 71.0%) or NEMG (about 35.7%) alone. These results indicated the feasibility to estimate eye-gaze with HEOG and NEMG.


title: On Understanding the Relation of Knowledge and Confidence to Requirements Quality

abstract: Context and Motivation: Software requirements are affected by the knowledge and confidence of software engineers. Analyzing the interrelated impact of these factors is difficult because of the challenges of assessing knowledge and confidence. Question/Problem: This research aims to draw attention to the need for considering the interrelated effects of confidence and knowledge on requirements quality, which has not been addressed by previous publications. Principal ideas/results: For this purpose, the following steps have been taken: 1) requirements quality was defined based on the instructions provided by the ISO29148:2011 standard, 2) we selected the symptoms of low qualified requirements based on ISO29148:2011, 3) we analyzed five Software Requirements Specification (SRS) documents to find these symptoms, 3) people who have prepared the documents were categorized in four classes to specify the more/less knowledge and confidence they have regarding the symptoms, and 4) finally, the relation of lack of enough knowledge and confidence to symptoms of low quality was investigated. The results revealed that the simultaneous deficiency of confidence and knowledge has more negative effects in comparison with a deficiency of knowledge or confidence. Contribution: In brief, this study has achieved these results: 1) the realization that a combined lack of knowledge and confidence has a larger effect on requirements quality than only one of the two factors, 2) the relation between low qualified requirements and requirements engineers' needs for knowledge and confidence, and 3) variety of requirements engineers' needs for knowledge based on their abilities to make discriminative and consistent decisions.


title: Efficient flexible characterization of quantum processors with nested error models

abstract: We present a simple and powerful technique for finding a good error model for a quantum processor. The technique iteratively tests a nested sequence of models against data obtained from the processor, and keeps track of the best-fit model and its wildcard error (a quantification of the unmodeled error) at each step. Each best-fit model, along with a quantification of its unmodeled error, constitute a characterization of the processor. We explain how quantum processor models can be compared with experimental data and to each other. We demonstrate the technique by using it to characterize a simulated noisy 2-qubit processor.


title: User Generated HDR Gaming Video Streaming: Dataset, Codec Comparison and Challenges

abstract: Gaming video streaming services have grown tremendously in the past few years, with higher resolutions, higher frame rates and HDR gaming videos getting increasingly adopted among the gaming community. Since gaming content as such is different from non-gaming content, it is imperative to evaluate the performance of the existing encoders to help understand the bandwidth requirements of such services, as well as further improve the compression efficiency of such encoders. Towards this end, we present in this paper GamingHDRVideoSET, a dataset consisting of eighteen 10-bit UHD-HDR gaming videos and encoded video sequences using four different codecs, together with their objective evaluation results. The dataset is available online at [to be added after paper acceptance]. Additionally, the paper discusses the codec compression efficiency of most widely used practical encoders, i.e., x264 (H.264/AVC), x265 (H.265/HEVC) and libvpx (VP9), as well the recently proposed encoder libaom (AV1), on 10-bit, UHD-HDR content gaming content. Our results show that the latest compression standard AV1 results in the best compression efficiency, followed by HEVC, H.264, and VP9.


title: An Iterative Contextualization Algorithm with Second-Order Attention

abstract: Combining the representations of the words that make up a sentence into a cohesive whole is difficult, since it needs to account for the order of words, and to establish how the words present relate to each other. The solution we propose consists in iteratively adjusting the context. Our algorithm starts with a presumably erroneous value of the context, and adjusts this value with respect to the tokens at hand. In order to achieve this, representations of words are built combining their symbolic embedding with a positional encoding into single vectors. The algorithm then iteratively weighs and aggregates these vectors using our novel second-order attention mechanism. Our models report strong results in several well-known text classification tasks.


title: Extracting Optimal Explanations for Ensemble Trees via Logical Reasoning

abstract: Ensemble trees are a popular machine learning model which often yields high prediction performance when analysing structured data. Although individual small decision trees are deemed explainable by nature, an ensemble of large trees is often difficult to understand. In this work, we propose an approach called optimised explanation (OptExplain) that faithfully extracts global explanations of ensemble trees using a combination of logical reasoning, sampling and optimisation. Building on top of this, we propose a method called the profile of equivalent classes (ProClass), which uses MAX-SAT to simplify the explanation even further. Our experimental study on several datasets shows that our approach can provide high-quality explanations to large ensemble trees models, and it betters recent top-performers.


title: On the Ricci curvature of homogeneous Finsler spaces with $(\alpha,\beta)$-metrics

abstract: The study of curvature properties of homogeneous Finsler spaces with $(\alpha, \beta)$-metrics is one of the central problems in Riemann-Finsler geometry. In this paper, we consider homogeneous Finsler spaces with square metric and Randers change of square metric. First, we derive the explicit formulae for Ricci curvature of homogeneous Finsler spaces with these metrics. Next, we find a necessary and sufficient condition under which a homogeneous Finsler space with either of these metrics is of vanishing $S$-curvature. The formulae for Ricci curvature of homogeneous Finsler spaces with square metric and Randers change of square metric having vanishing $S$-curvature are established. Finally, we prove that the aforesaid spaces having vanishing $S$-curvature and negative Ricci curvature must be Riemannian.


title: Adaptive Consistency Regularization for Semi-Supervised Transfer Learning

abstract: While recent studies on semi-supervised learning have shown remarkable progress in leveraging both labeled and unlabeled data, most of them presume a basic setting of the model is randomly initialized. In this work, we consider semi-supervised learning and transfer learning jointly, leading to a more practical and competitive paradigm that can utilize both powerful pre-trained models from source domain as well as labeled/unlabeled data in the target domain. To better exploit the value of both pre-trained weights and unlabeled target examples, we introduce adaptive consistency regularization that consists of two complementary components: Adaptive Knowledge Consistency (AKC) on the examples between the source and target model, and Adaptive Representation Consistency (ARC) on the target model between labeled and unlabeled examples. Examples involved in the consistency regularization are adaptively selected according to their potential contributions to the target task. We conduct extensive experiments on popular benchmarks including CIFAR-10, CUB-200, and MURA, by fine-tuning the ImageNet pre-trained ResNet-50 model. Results show that our proposed adaptive consistency regularization outperforms state-of-the-art semi-supervised learning techniques such as Pseudo Label, Mean Teacher, and FixMatch. Moreover, our algorithm is orthogonal to existing methods and thus able to gain additional improvements on top of MixMatch and FixMatch. Our code is available at https://github.com/SHI-Labs/Semi-Supervised-Transfer-Learning.


title: Strained BiFeO$_{3}$ perovskite structure for enhanced photovoltaic effect

abstract: BiFeO$_{3}$ is multiferroic material with space group Pbnm exhibits coupling of both magnetic and electric orders under strain force. To analyze band gap Tauc plot extrapolation method is used $\&$ remarkably smaller than some reported literature values for space group R3c structure. The dielectric function $\varepsilon(\omega)$ demonstrated that light energy upon transition through BiFeO$_{3}$ has shown a decline inconsistent pattern with index of refraction variation in range of 13 to 8, 8 to 5, 5 to 3, $\&$ 3 to 1 as per photon energy. Moreover, non crossing degenerate energy level and hybridized spin-orbit interaction lead to linear dispersion relation which is typical photonic nature with zero DM interaction. Thus, BiFeO$_{3}$ could exhibit photonic property under strain force. Generally strained structure had enhanced photovoltaic effect with smaller optical band gap because of $Dzyaloshinskii$-$Moriya(DM)$ and spin-orbit coupling interactions.


title: On Opportunistic Selection of Common Randomness and LLR generation for Algebraic Group Secret-Key Generation

abstract: It is well known that physical-layer key generation methods enable wireless devices to harvest symmetric keys by accessing the randomness offered by the wireless channels. Although two-user key generation is well understood, group secret-key (GSK) generation, wherein more than two nodes in a network generate secret-keys, still poses open problems. Recently, Manish Rao et al., have proposed the Algebraic Symmetrically Quantized GSK (A-SQGSK) protocol for a network of three nodes wherein the nodes share quantized versions of the channel realizations over algebraic rings, and then harvest a GSK. Although A-SQGSK protocol guarantees confidentiality of common randomness to an eavesdropper, we observe that the key-rate of the protocol is poor since only one channel in the network is used to harvest GSK. Identifying this limitation, in this paper, we propose an opportunistic selection method wherein more than one wireless channel is used to harvest GSKs without compromising the confidentiality feature, thereby resulting in remarkable improvements in the key-rate. Furthermore, we also propose a log-likelihood ratio (LLR) generation method for the common randomness observed at various nodes, so that the soft-values are applied to execute LDPC codes based reconciliation to reduce the bit mismatches among the nodes.


title: The Architected Multi-material Scintillator System: Designs and Modeling

abstract: We present a new conceptual radiation detector, the Architected Multimaterial Scintillator System, that utilizes a scintillator composed of multiple materials arranged in architected structures to enable new capabilities. By structuring differently-dyed materials, the wavelength of the scintillation light encodes additional information in radiation measurements. These structures can be realized through additive manufacture (3D-printing). Two classes of this concept are described and modelled using Monte Carlo simulations to evaluate their performance. The first detector design uses dye microstructures to encode particle tracking information, allowing for directional neutron detection and gamma/neutron discrimination. The second design uses a dye gradient to indicate the position of radiation along the gradient. The simulation results indicate this new concept in radiation detection can achieve strong performance in a variety of capabilities including particle identification, directionality and spectroscopy measurements, and particle position reconstruction.


title: Decoding Event-related Potential from Ear-EEG Signals based on Ensemble Convolutional Neural Networks in Ambulatory Environment

abstract: Recently, practical brain-computer interface is actively carried out, especially, in an ambulatory environment. However, the electroencephalography (EEG) signals are distorted by movement artifacts and electromyography signals when users are moving, which make hard to recognize human intention. In addition, as hardware issues are also challenging, ear-EEG has been developed for practical brain-computer interface and has been widely used. In this paper, we proposed ensemble-based convolutional neural networks in ambulatory environment and analyzed the visual event-related potential responses in scalp- and ear-EEG in terms of statistical analysis and brain-computer interface performance. The brain-computer interface performance deteriorated as 3-14% when walking fast at 1.6 m/s. The proposed methods showed 0.728 in average of the area under the curve. The proposed method shows robust to the ambulatory environment and imbalanced data as well.


title: Bulk Production Augmentation Towards Explainable Melanoma Diagnosis

abstract: Although highly accurate automated diagnostic techniques for melanoma have been reported, the realization of a system capable of providing diagnostic evidence based on medical indices remains an open issue because of difficulties in obtaining reliable training data. In this paper, we propose bulk production augmentation (BPA) to generate high-quality, diverse pseudo-skin tumor images with the desired structural malignant features for additional training images from a limited number of labeled images. The proposed BPA acts as an effective data augmentation in constructing the feature detector for the atypical pigment network (APN), which is a key structure in melanoma diagnosis. Experiments show that training with images generated by our BPA largely boosts the APN detection performance by 20.0 percentage points in the area under the receiver operating characteristic curve, which is 11.5 to 13.7 points higher than that of conventional CycleGAN-based augmentations in AUC.


title: Local solvability and stability of the generalized inverse Robin-Regge problem with complex coefficients

abstract: We prove local solvability and stability of the inverse Robin-Regge problem in the general case, taking eigenvalue multiplicities into account. We develop the new approach based on the reduction of this inverse problem to the recovery of the Sturm-Liouville potential from the Cauchy data.


title: Formalizing Generalization and Robustness of Neural Networks to Weight Perturbations

abstract: Studying the sensitivity of weight perturbation in neural networks and its impacts on model performance, including generalization and robustness, is an active research topic due to its implications on a wide range of machine learning tasks such as model compression, generalization gap assessment, and adversarial attacks. In this paper, we provide the first integral study and analysis for feed-forward neural networks in terms of the robustness in pairwise class margin and its generalization behavior under weight perturbation. We further design a new theory-driven loss function for training generalizable and robust neural networks against weight perturbations. Empirical experiments are conducted to validate our theoretical analysis. Our results offer fundamental insights for characterizing the generalization and robustness of neural networks against weight perturbations.


title: Semantic constraints to represent common sense required in household actions for multi-modal Learning-from-observation robot

abstract: The paradigm of learning-from-observation (LfO) enables a robot to learn how to perform actions by observing human-demonstrated actions. Previous research in LfO have mainly focused on the industrial domain which only consist of the observable physical constraints between a manipulating tool and the robot's working environment. In order to extend this paradigm to the household domain which consists non-observable constraints derived from a human's common sense; we introduce the idea of semantic constraints. The semantic constraints are represented similar to the physical constraints by defining a contact with an imaginary semantic environment. We thoroughly investigate the necessary and sufficient set of contact state and state transitions to understand the different types of physical and semantic constraints. We then apply our constraint representation to analyze various actions in top hit household YouTube videos and real home cooking recordings. We further categorize the frequently appearing constraint patterns into physical, semantic, and multistage task groups and verify that these groups are not only necessary but a sufficient set for covering standard household actions. Finally, we conduct a preliminary experiment using textual input to explore the possibilities of combining verbal and visual input for recognizing the task groups. Our results provide promising directions for incorporating common sense in the literature of robot teaching.


title: Stim: a fast stabilizer circuit simulator

abstract: This paper presents ``Stim", a fast simulator for quantum stabilizer circuits. The paper explains how Stim works and compares it to existing tools. With no foreknowledge, Stim can analyze a distance 100 surface code circuit (20 thousand qubits, 8 million gates, 1 million measurements) in 15 seconds and then begin sampling full circuit shots at a rate of 1 kHz. Stim uses a stabilizer tableau representation, similar to Aaronson and Gottesman's CHP simulator, but with three main improvements. First, Stim improves the asymptotic complexity of deterministic measurement from quadratic to linear by tracking the {\em inverse} of the circuit's stabilizer tableau. Second, Stim improves the constant factors of the algorithm by using a cache-friendly data layout and 256 bit wide SIMD instructions. Third, Stim only uses expensive stabilizer tableau simulation to create an initial reference sample. Further samples are collected in bulk by using that sample as a reference for batches of Pauli frames propagating through the circuit.


title: A General Framework to Derive Linear, Decoupled and Energy-stable Schemes for Reversible-Irreversible Thermodynamically Consistent Models: Part I Incompressible Hydrodynamic Models

abstract: In this paper, we present a general numerical platform for designing accurate, efficient, and stable numerical algorithms for incompressible hydrodynamic models that obeys the thermodynamical laws. The obtained numerical schemes are automatically linear in time. It decouples the hydrodynamic variable and other state variables such that only small-size linear problems need to be solved at each time marching step. Furthermore, if the classical velocity projection method is utilized, the velocity field and pressure field can be decoupled. In the end, only a few elliptic-type equations shall be solved in each time step. This strategy is made possible through a sequence of model reformulations by fully exploring the models' thermodynamic structures. The generalized Onsager principle directly guides these reformulation procedures. In the reformulated but equivalent models, the reversible and irreversible components can be identified, guiding the numerical platform to decouple the reversible and irreversible dynamics. This eventually leads to decoupled numerical algorithms, given that the coupling terms only involve irreversible dynamics. To further demonstrate the numerical platform's power, we apply it to several specific incompressible hydrodynamic models. The energy stability of the proposed numerical schemes is shown in detail. The second-order accuracy in time is verified numerically through time step refinement tests. Several benchmark numerical examples are presented to further illustrate the proposed numerical framework's accuracy, stability, and efficiency.


title: $\mathbb{A}^1$-homotopy equivalences and a theorem of Whitehead

abstract: We prove analogs of Whitehead's theorem (from algebraic topology) for both the Chow groups and for the Grothendieck group of coherent sheaves: a morphism between smooth projective varieties whose pushforward is an isomorphism on the Chow groups, or on the Grothendieck group of coherent sheaves, is an isomorphism. As a corollary, we show that there are no nontrivial naive $\mathbb{A}^1$-homotopy equivalences between smooth projective varieties.


title: Gradual Fine-Tuning for Low-Resource Domain Adaptation

abstract: Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We demonstrate that gradually fine-tuning in a multi-stage process can yield substantial further gains and can be applied without modifying the model or learning objective.


title: Efficient linear optical generation of a multipartite W state

abstract: A novel scheme is presented for generation of a multipartite W state for arbitrary number of qubits. Based on a recent proposal of entanglement without touching, it serves to demonstrate the potential of particle indistinguishability as a useful resource of entanglement for practical applications. The devised scheme is efficient in design, meaning that it is built with linear optics without the need for auxiliary particles nor measurements. Yet, the success probability is shown to be highly competitive compared with the existing proposals (i.e. decreases polynomially with the number of qubits) and remains insensitive to particle statistics (i.e. has the same efficiency for bosons and fermions).


title: EaZy Learning: An Adaptive Variant of Ensemble Learning for Fingerprint Liveness Detection

abstract: In the field of biometrics, fingerprint recognition systems are vulnerable to presentation attacks made by artificially generated spoof fingerprints. Therefore, it is essential to perform liveness detection of a fingerprint before authenticating it. Fingerprint liveness detection mechanisms perform well under the within-dataset environment but fail miserably under cross-sensor (when tested on a fingerprint acquired by a new sensor) and cross-dataset (when trained on one dataset and tested on another) settings. To enhance the generalization abilities, robustness and the interoperability of the fingerprint spoof detectors, the learning models need to be adaptive towards the data. We propose a generic model, EaZy learning which can be considered as an adaptive midway between eager and lazy learning. We show the usefulness of this adaptivity under cross-sensor and cross-dataset environments. EaZy learning examines the properties intrinsic to the dataset while generating a pool of hypotheses. EaZy learning is similar to ensemble learning as it generates an ensemble of base classifiers and integrates them to make a prediction. Still, it differs in the way it generates the base classifiers. EaZy learning develops an ensemble of entirely disjoint base classifiers which has a beneficial influence on the diversity of the underlying ensemble. Also, it integrates the predictions made by these base classifiers based on their performance on the validation data. Experiments conducted on the standard high dimensional datasets LivDet 2011, LivDet 2013 and LivDet 2015 prove the efficacy of the model under cross-dataset and cross-sensor environments.


title: On the solution of contact problems with Tresca friction by the semismooth* Newton method

abstract: An equilibrium of a linear elastic body subject to loading and satisfying the friction and contact conditions can be described by a variational inequality of the second kind and the respective discrete model attains the form of a generalized equation. To its numerical solution we apply the semismooth* Newton method by Gfrerer and Outrata (2019) in which, in contrast to most available Newton-type methods for inclusions, one approximates not only the single-valued but also the multi-valued part. This is performed on the basis of limiting (Morduchovich) coderivative. In our case of the Tresca friction, the multi-valued part amounts to the subdifferential of a convex function generated by the friction and contact conditions. The full 3D discrete problem is then reduced to the contact boundary. Implementation details of the semismooth* Newton method are provided and numerical tests demonstrate its superlinear convergence and mesh independence.


title: SciviK: A Versatile Framework for Specifying and Verifying Smart Contracts

abstract: The growing adoption of smart contracts on blockchains poses new security risks that can lead to significant monetary loss, while existing approaches either provide no (or partial) security guarantees for smart contracts or require huge proof effort. To address this challenge, we present SciviK, a versatile framework for specifying and verifying industrial-grade smart contracts. SciviK's versatile approach extends previous efforts with three key contributions: (i) an expressive annotation system enabling built-in directives for vulnerability pattern checking, neural-based loop invariant inference, and the verification of rich properties of real-world smart contracts (ii) a fine-grained model for the Ethereum Virtual Machine (EVM) that provides low-level execution semantics, (iii) an IR-level verification framework integrating both SMT solvers and the Coq proof assistant. We use SciviK to specify and verify security properties for 12 benchmark contracts and a real-world Decentralized Finance (DeFi) smart contract. Among all 158 specified security properties (in six types), 151 properties can be automatically verified within 2 seconds, five properties can be automatically verified after moderate modifications, and two properties are manually proved with around 200 lines of Coq code.


title: Second-order Decoupled Energy-stable Schemes for Cahn-Hilliard-Navier-Stokes equations

abstract: The Cahn-Hilliard-Navier-Stokes (CHNS) equations represent the fundamental building blocks of hydrodynamic phase-field models for multiphase fluid flow dynamics. Due to the coupling between the Navier-Stokes equation and the Cahn-Hilliard equation, the CHNS system is non-trivial to solve numerically. Traditionally, a numerical extrapolation for the coupling terms is used. However, such brute-force extrapolation usually destroys the intrinsic thermodynamic structures of this CHNS system. This paper proposes a new strategy to reformulate the CHNS system into a constraint gradient flow formation. Under the new formulation, the reversible and irreversible structures are clearly revealed. This guides us to propose operator splitting schemes. The operator splitting schemes have several advantageous properties. First of all, the proposed schemes lead to several decoupled systems in smaller sizes to be solved at each time marching step. This significantly reduces computational costs. Secondly, the proposed schemes still guarantee the thermodynamic laws of the CHNS system at the discrete level. It ensures the thermodynamic laws, accuracy, and stability for the numerical solutions. In addition, unlike the recently populated IEQ or SAV approach using auxiliary variables, our resulting energy laws are formulated in the original variables. Our proposed framework lays out a foundation to design decoupled and energy stable numerical algorithms for hydrodynamic phase-field models. Furthermore, given different splitting steps, various numerical algorithms can be obtained, making this framework rather general. The proposed numerical algorithms are implemented. Their second-order accuracy in time is verified numerically. Some numerical examples and benchmark problems are calculated to verify the effectiveness of the proposed schemes.


title: K-FACE: A Large-Scale KIST Face Database in Consideration with Unconstrained Environments

abstract: In this paper, we introduce a new large-scale face database from KIST, denoted as K-FACE, and describe a novel capturing device specifically designed to obtain the data. The K-FACE database contains more than 1 million high-quality images of 1,000 subjects selected by considering the ratio of gender and age groups. It includes a variety of attributes, including 27 poses, 35 lighting conditions, three expressions, and occlusions by the combination of five types of accessories. As the K-FACE database is systematically constructed through a hemispherical capturing system with elaborate lighting control and multiple cameras, it is possible to accurately analyze the effects of factors that cause performance degradation, such as poses, lighting changes, and accessories. We consider not only the balance of external environmental factors, such as pose and lighting, but also the balance of personal characteristics such as gender and age group. The gender ratio is the same, while the age groups of subjects are uniformly distributed from the 20s to 50s for both genders. The K-FACE database can be extensively utilized in various vision tasks, such as face recognition, face frontalization, illumination normalization, face age estimation, and three-dimensional face model generation. We expect systematic diversity and uniformity of the K-FACE database to promote these research fields.


title: Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformation

abstract: Linear embedding transformation has been shown to be effective for zero-shot cross-lingual transfer tasks and achieve surprisingly promising results. However, cross-lingual embedding space mapping is usually studied in static word-level embeddings, where a space transformation is derived by aligning representations of translation pairs that are referred from dictionaries. We move further from this line and investigate a contextual embedding alignment approach which is sense-level and dictionary-free. To enhance the quality of the mapping, we also provide a deep view of properties of contextual embeddings, i.e., anisotropy problem and its solution. Experiments on zero-shot dependency parsing through the concept-shared space built by our embedding transformation substantially outperform state-of-the-art methods using multilingual embeddings.


title: Emergence of internetwork magnetic fields through the solar atmosphere

abstract: Internetwork (IN) magnetic fields are highly dynamic, short-lived magnetic structures that populate the interior of supergranular cells. Since they emerge all over the Sun, these small-scale fields bring a substantial amount of flux, and therefore energy, to the solar surface. Because of this, IN fields are crucial for understanding the quiet Sun (QS) magnetism. However, they are weak and produce very small polarization signals, which is the reason why their properties and impact on the energetics and dynamics of the solar atmosphere are poorly known. Here we use coordinated, high-resolution, multiwavelength observations obtained with the Swedish 1-m Solar Telescope (SST) and the \textit{Interface Region Imaging Spectrograph} (IRIS) to follow the evolution of IN magnetic loops as they emerge into the photosphere and reach the chromosphere and transition region. We studied in this paper three flux emergence events having total unsigned magnetic fluxes of $1.9\times10^{18}$, $2.5\times10^{18}$, and $5.3\times10^{18}$~Mx. The footpoints of the emerging IN bipoles are clearly seen to appear in the photosphere and to rise up through the solar atmosphere, as observed in \ion{Fe}{1} 6173 \AA\/ and \ion{Mg}{1} b$_2$ 5173 \AA\/ magnetograms, respectively. For the first time, our polarimetric measurements taken in the chromospheric \ion{Ca}{2} 8542 \AA\/ line provide direct observational evidence that IN fields are capable of reaching the chromosphere. Moreover, using IRIS data, we study the effects of these weak fields on the heating of the chromosphere and transition region.